-- Logs begin at Tue 2021-12-07 18:03:45 UTC, end at Tue 2021-12-07 19:06:39 UTC. -- Dec 07 18:36:20.453069 dv-cinder-819692-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 07 18:36:20.461991 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 7 18:36:20 2021] *** Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: nodename: dv-cinder-819692-6-iscsi Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: machine: x86_64 Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: clock source: unix Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: pcre jit disabled Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: detected number of CPU cores: 4 Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: current working directory: / Dec 07 18:36:20.463827 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: detected binary path: /usr/bin/uwsgi-core Dec 07 18:36:20.465224 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: your processes number limit is 47680 Dec 07 18:36:20.465224 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: your memory page size is 4096 bytes Dec 07 18:36:20.465224 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: detected max file descriptor number: 2048 Dec 07 18:36:20.465224 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: lock engine: pthread robust mutexes Dec 07 18:36:20.465224 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: thunder lock: enabled Dec 07 18:36:20.465224 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 07 18:36:20.465224 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 07 18:36:20.509449 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: Python main interpreter initialized at 0x5568d8abe9c0 Dec 07 18:36:20.509449 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: python threads support enabled Dec 07 18:36:20.509449 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: your server socket listen backlog is limited to 100 connections Dec 07 18:36:20.509449 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: your mercy for graceful operations on workers is 90 seconds Dec 07 18:36:20.509807 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: mapped 403077 bytes (393 KB) for 2 cores Dec 07 18:36:20.509886 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: *** Operational MODE: preforking *** Dec 07 18:36:20.510142 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: *** uWSGI is running in multiple interpreter mode *** Dec 07 18:36:20.510142 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: spawned uWSGI master process (pid: 108389) Dec 07 18:36:20.510340 dv-cinder-819692-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 07 18:36:20.511944 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: spawned uWSGI worker 1 (pid: 108390, cores: 1) Dec 07 18:36:20.511944 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: spawned uWSGI worker 2 (pid: 108391, cores: 1) Dec 07 18:36:20.511944 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 07 18:36:22.232019 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:36:22.232019 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: from cryptography.utils import int_from_bytes Dec 07 18:36:22.232702 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:36:22.232702 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: from cryptography.utils import int_from_bytes Dec 07 18:36:22.270302 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:36:22.270302 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: from cryptography.utils import int_from_bytes Dec 07 18:36:22.270886 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:36:22.270886 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: from cryptography.utils import int_from_bytes Dec 07 18:36:24.868861 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 07 18:36:24.869513 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 07 18:36:24.870060 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 07 18:36:24.871133 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 07 18:36:24.871360 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 07 18:36:24.871735 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 07 18:36:24.871994 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 07 18:36:24.872385 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.872715 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.873041 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.873365 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.873698 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.873838 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 07 18:36:24.874042 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.874262 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 07 18:36:24.874373 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.874533 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 07 18:36:24.874703 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.874937 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.875032 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.875281 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.875617 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.875949 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.876290 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.876543 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.876703 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.876902 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.877251 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819692-6-iscsi {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.877384 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.877589 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.877890 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.878118 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.878242 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.878529 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.878656 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.878962 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.879197 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.879539 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819692-6-iscsi {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.879671 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.879875 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.880001 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.880196 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.880329 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.880517 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.880758 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.880910 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.881147 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.881483 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.881604 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.881798 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.881946 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.882369 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.882670 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.882990 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.883309 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.883654 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.883992 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.884368 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.884516 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.884730 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.884920 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.884920 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.885247 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.885459 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.885615 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.885824 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.886068 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.886217 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.886546 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.886879 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.886975 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819692-6-iscsi {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.887300 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819692-6-iscsi {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.887519 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.887620 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.888132 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.888228 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.888469 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.888576 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.888902 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.889023 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.889229 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.889400 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.889551 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.890171 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.890324 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.890475 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.890634 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.890771 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.890932 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.891073 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.891258 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.891551 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.891667 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.891901 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.892091 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.892207 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.892520 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.892613 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.892833 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.893102 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.893190 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.893456 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.893607 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.893766 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.894046 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.894151 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.894361 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.894586 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.894682 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.894995 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.895084 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.895322 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.895549 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.895637 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.895820 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.896030 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.896142 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.896468 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.896556 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.896778 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.896876 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.897089 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.897353 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.897448 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.897697 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.897854 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.898032 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.898345 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.898439 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.898655 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.898888 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.898978 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.899270 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.899446 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.899594 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.899765 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.899914 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.900130 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.900283 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.900520 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.900662 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.900920 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.901089 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.901250 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.901624 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.901769 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.902015 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.902175 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.902346 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.902608 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.902751 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.902971 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.903119 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.903295 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.903554 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.903697 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.903902 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.904044 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.904216 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.904485 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.904647 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.904863 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.905012 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.905177 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.905432 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.905574 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.905723 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.905967 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.906114 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.906369 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.906517 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.906681 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.906936 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.907080 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.907288 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.907554 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.907706 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.907888 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.908031 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.908196 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.908421 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.908564 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.908802 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.908952 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.909096 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.909415 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.909560 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.909718 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.909900 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.910068 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.910343 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.910486 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.910662 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.910907 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.911057 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.911279 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.911432 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.911577 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.911849 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.911992 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.912179 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.912321 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.912500 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.912809 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.912951 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.913116 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.913322 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.913473 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.913732 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.913880 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.914049 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.914197 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.914371 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.914662 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.914805 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.914973 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.915144 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.915287 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.915584 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.915727 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.915894 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.916101 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.916243 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.916504 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.916655 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.916794 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.917536 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.917759 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.917901 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.918064 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.918235 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.918526 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.918670 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.918836 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.919006 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.919149 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.919431 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.919575 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.919752 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.919953 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.920097 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.920373 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.920515 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.920683 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.920894 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.921043 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.921298 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.921447 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.921635 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.921850 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.922032 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.922312 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.922465 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.922620 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.922756 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.922951 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.923097 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.923284 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.923435 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.923603 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.923885 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.924034 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.924219 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.924472 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.924638 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.924830 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.924974 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.925144 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.925376 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.925518 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.925714 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.925864 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.926080 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.926224 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.926431 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.926580 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.926753 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.927034 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.927177 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.927382 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.927524 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.927696 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.928012 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.928158 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.928342 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.928484 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.928669 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.928829 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.928978 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.929159 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.929308 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.929469 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.929651 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.929970 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.930095 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.930313 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.930465 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.930630 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.930944 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.931052 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.931273 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.931477 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.931576 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.931873 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.931977 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.932206 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.932307 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.932519 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.932659 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.933562 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.933655 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.933938 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.934389 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.934518 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.934843 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.934956 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.935158 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.935390 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.935480 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.935771 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.935867 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.936090 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.936210 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.936402 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.936530 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.936728 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.936847 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.937061 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.937168 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.937371 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.937468 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:36:24.937710 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.937800 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.938057 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.938163 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.938377 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.938467 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.938692 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.938781 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.939003 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.939100 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.939316 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.939406 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.939629 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.939718 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.939940 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.940055 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.940270 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.940371 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.940582 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.940670 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.940892 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.940994 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.941218 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.941316 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.941529 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.941616 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.941838 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.941953 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.942195 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.942331 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.942495 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.942592 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.942809 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.942899 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.943119 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.943212 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.943437 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.943527 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.943747 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.943836 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.944059 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.944148 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.944383 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.944549 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.944707 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.944802 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.945011 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.945099 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.945339 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.945440 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.945667 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.945756 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.945998 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.946089 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.946309 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.946410 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.946620 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.946716 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.946927 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.947014 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.947235 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.947334 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.947543 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.947633 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.947850 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.947936 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.948155 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.948244 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.948516 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.948604 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.948885 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.948981 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.949197 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.949295 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.949507 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.949595 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.949834 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.949991 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.950167 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.950280 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.950477 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.950575 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.950777 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.950865 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.951081 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.951176 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.951381 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.951471 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.951699 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.951800 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.952025 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.952115 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.952371 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.952522 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.952660 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.952764 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.952966 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.953065 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.953276 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.953366 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.953588 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.953686 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.953893 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.954017 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.954227 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.954315 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.954538 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.954638 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.954842 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.954939 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.955163 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.955251 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.955471 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.955571 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.955777 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.955865 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.956089 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.956183 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.956390 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.956535 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.956695 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.956786 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.957009 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.957098 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.957313 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.957402 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.957620 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.957716 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.957948 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.958041 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.958279 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.958371 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.958588 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.958676 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.958895 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.958983 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.959214 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.959303 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.959533 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.959629 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.959833 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.959933 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.960146 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.960243 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.960459 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.960601 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.960770 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.960871 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.961072 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.961162 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.961379 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.961475 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.961681 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.961817 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.962004 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.962094 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.962310 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.962397 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.962615 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.962723 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.962917 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.963015 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.963219 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.963314 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.963521 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.963610 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.963855 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.963978 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.964249 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.964336 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.964565 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.964705 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.964882 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.965020 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.965208 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.965329 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.965524 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.965620 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.965839 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.965965 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.966182 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.966270 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.966492 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.966582 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.966801 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.966893 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.967115 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.967213 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.967433 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.967522 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.967746 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.967835 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.968058 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.968156 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.968366 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.968457 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.968682 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.968777 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.968995 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.969093 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.969303 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.969391 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.969609 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.969702 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.969933 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.970038 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.970251 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.970342 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.970565 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.970689 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.970872 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.970968 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.971194 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.971285 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.971502 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.971590 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.971809 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.971899 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.972110 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.972197 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.972423 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.972519 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.972726 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.972816 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.973033 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.973127 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.973341 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.973433 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.973679 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.973769 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.974010 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.974103 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.974320 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.974407 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.974627 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.974722 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.974934 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.975023 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.975242 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.975339 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.975557 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.975683 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.975909 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.975998 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.976224 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.976323 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.976551 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.976640 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.976867 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.976957 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.977178 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.977277 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.977483 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.977571 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.977794 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.977882 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.978121 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.978222 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.978437 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.978524 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.978761 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.978848 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.979070 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.979159 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.979386 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.980011 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.980240 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.980332 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.980557 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.980677 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.980865 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.980958 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.981185 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.981276 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.981547 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.981771 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.981860 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.982142 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.982233 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.982465 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.982567 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.982781 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.982877 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.983092 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.983188 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.983403 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.983493 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.983707 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.983795 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.984020 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.984108 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.984329 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.984419 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.984631 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.984720 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.984933 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.985022 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.985243 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.985332 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.985551 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.985638 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.985857 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.985963 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.986216 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.986306 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.986525 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.986612 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.986825 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.986961 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.987128 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.987217 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.987435 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.987522 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.987743 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.987838 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.988045 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.988142 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.988347 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.988435 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.988650 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.988751 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.988976 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.989066 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.989292 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.989379 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.989595 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.989684 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990028 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990136 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990250 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990389 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990560 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990649 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990871 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.990958 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.991178 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.991266 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.991483 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.991571 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.991804 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.991894 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.992116 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.992207 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.992423 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.992524 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.992734 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.992822 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.993042 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.993131 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.993350 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.993448 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.993659 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.993749 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.994002 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.994093 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.994312 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.994412 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.994621 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.994710 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.994931 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.995029 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.995778 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.995879 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.996094 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.996233 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.996437 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.996526 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.996754 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.997004 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.997099 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.997337 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.997431 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.997651 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.997748 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.997983 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.998075 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.998294 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.998382 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.998611 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.998713 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.998921 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.999009 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.999228 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.999315 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.999536 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.999635 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.999842 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:24.999929 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.000150 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.000238 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.000452 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.000540 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.000758 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.000846 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.001061 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.001149 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.001363 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.001453 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.001667 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.001757 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.001994 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.002087 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.002302 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.002392 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.002602 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.002690 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.002910 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.002999 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.003214 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.003303 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.003538 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.003628 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.003852 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.003949 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.004155 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.004252 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.004461 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.004548 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.004763 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.004859 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.005067 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.005156 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.005374 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.005462 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.005673 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.005767 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.006000 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.006103 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.006310 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.006399 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.006622 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.006710 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.006934 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.007024 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.007241 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.007331 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.007550 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.007643 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.007857 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.007946 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.008167 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.008257 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.008473 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.008572 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.008780 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.008869 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.009086 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.009179 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.009391 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.009492 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.009691 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.009779 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.010031 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.010125 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.010342 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.010443 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.010646 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.010771 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.010985 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.011111 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.011379 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.011478 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.011586 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.011683 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.011894 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.011990 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.012195 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.012286 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.012502 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.012598 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.012803 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.012892 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.013113 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.013203 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.013419 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.013508 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.013720 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.013809 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.014048 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.014142 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.014359 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.014459 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.014666 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.014784 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.014969 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.015061 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.015276 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.015371 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.015576 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.015677 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.015880 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.015968 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.016180 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.016268 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.016481 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.016578 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.016781 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.016872 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.017087 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.017183 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.017395 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.017497 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.017698 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.017787 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.018052 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.018143 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.018366 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.018471 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.018673 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.018788 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.018975 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.019068 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.019281 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.019380 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.019582 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.019672 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.019880 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.019969 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.020188 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.020278 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.020499 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.020598 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.020810 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.020903 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.021111 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.021245 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.021417 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.021506 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.021717 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.021806 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.022044 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.022137 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.022347 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.022460 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.022654 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.022775 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.022956 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.023045 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.023256 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.023354 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.023556 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.023657 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.023855 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.023944 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.024164 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.024251 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.024473 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.024569 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.024793 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.024891 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.025095 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.025193 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.025397 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.025495 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.025698 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.025787 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.026072 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.026167 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.026423 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.026670 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.026785 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.026885 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.027094 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.027183 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.027412 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.027504 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.027732 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.027850 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.028045 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.028170 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.028354 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.028487 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.028670 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.028804 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.028975 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.029114 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.029288 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.029423 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.029596 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.029737 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.029920 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.030095 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.030234 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.030407 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.030538 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.030715 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.030852 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.031026 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.031153 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.031358 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.031446 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.031668 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.031757 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.031991 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.032082 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.032381 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.032469 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.032682 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.032771 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.032988 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.033084 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.033297 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.033392 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.033604 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.033693 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.033948 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.034053 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.034244 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.034333 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.034554 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.034690 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.034863 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.034960 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.035171 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.035260 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.035480 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.035577 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.035789 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.035885 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.036093 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.036189 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.036400 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.036498 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.036707 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.036802 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.037009 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.037099 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.037330 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.037428 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.037642 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.037740 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.037968 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.038061 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.038279 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.038371 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.038589 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.038679 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.038898 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.039047 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.039203 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.039376 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.039628 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.039716 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.039943 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.040031 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.040255 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.040351 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.040561 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.040657 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.040873 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.040962 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.041187 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.041277 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.041499 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.041586 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.041807 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.042450 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.042658 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.042746 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.043055 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.043180 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.043373 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.043473 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.043682 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.043771 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.043991 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.044079 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.044295 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.044392 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.044601 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.044703 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.044913 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.045005 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.045218 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.045315 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.045529 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.045616 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.045833 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.045941 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.046161 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.046252 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.046487 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.046575 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.046792 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.046881 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.047110 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.047218 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.047420 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.047509 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.047730 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.047829 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.048036 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.048125 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.048344 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.048505 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.048690 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.048817 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.048999 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.049136 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.049322 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.049459 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.049654 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.049782 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.050009 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.050134 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.050325 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.050441 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.050661 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.050750 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.050993 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.051090 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.051314 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.051405 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.051638 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.051727 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.051960 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.052058 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.052269 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.052356 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.052569 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.052656 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.052879 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.052977 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.053188 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.053315 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.053498 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.053590 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.053804 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.053903 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.054145 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.054246 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.054454 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.054543 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.054763 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.054860 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.055070 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.055158 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.055396 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.055494 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.055703 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.055800 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.056027 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.056117 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.056333 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.056420 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.056637 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.056727 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.056936 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.057023 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.057242 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.057331 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.057583 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.057675 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.057963 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.058048 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.058276 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.058393 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.058582 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.058672 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.058886 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.058982 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.059450 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.059556 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.059773 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.059862 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.060076 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.060164 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.060395 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.060494 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.060708 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.060805 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.061026 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.061122 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.061342 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.061438 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.061645 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.061740 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.061987 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.062084 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.062297 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.062388 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.062600 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.062691 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.062902 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.063014 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.063205 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.063296 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.063523 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.063611 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.063836 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.064054 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.064152 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.064386 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.064478 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.064700 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.064789 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.065016 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.065139 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.065330 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.065420 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.065646 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.065736 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.065985 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.066081 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.066303 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.066395 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.066616 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.066705 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.066929 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.067019 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.067229 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.067315 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.067539 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.067635 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.067841 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.067932 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.068142 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.068295 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.068445 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.068548 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.068751 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.068841 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.069057 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.069149 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.069359 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.069502 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.069660 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.069749 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.070000 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.070091 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.070306 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.070397 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.070627 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.070716 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.070936 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.071027 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.071239 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.071329 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.071542 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.071631 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.071845 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.071939 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.072184 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.072281 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.072489 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.072579 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.072805 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.072892 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.073121 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.073245 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.073461 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.073561 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.073778 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.073877 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.074109 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.074199 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.074428 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.074517 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.074742 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.074877 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.075057 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.075147 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.075372 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.075467 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.075683 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.075780 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.075996 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.076085 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.076308 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.076513 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.076622 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.076833 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.076930 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.077172 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.077263 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.077500 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.077601 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.077826 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.077935 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.078178 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.078364 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.078551 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.078690 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.078887 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.079005 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.079198 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.079317 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.079507 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.079627 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.079823 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.079938 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.080133 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.080251 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.080441 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.080561 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.080768 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.080864 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.081083 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.081172 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.081391 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.081482 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.081720 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.081810 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.082057 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.082151 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.082417 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.082589 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.082753 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.082943 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.083068 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.083265 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.083365 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.083595 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.083684 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.083923 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.084020 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.084246 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.084337 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.084556 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.084649 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.084882 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.084972 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.085192 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.085282 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.085500 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.085597 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.085810 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.085926 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.086145 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.086235 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.086450 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.086537 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.086756 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.086860 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.087067 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.087163 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.087376 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.087470 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.087682 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.087783 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.087990 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.088078 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.088296 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.088385 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.088614 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.088711 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.089434 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.089538 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.089744 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.089859 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.090078 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.090205 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.090391 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.090522 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.090699 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.090840 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.091004 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.091309 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.091397 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.091614 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.091703 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.091928 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.092075 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.092241 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.092337 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.092552 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.092641 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.092858 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.092956 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.093174 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.093263 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.093479 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.093575 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.093789 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.093880 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.094123 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.094213 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.094439 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.094529 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.094745 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.094841 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.095049 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.095145 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.095363 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.095451 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.095671 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.095760 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.095977 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.096066 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.096293 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.096381 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.096646 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.096754 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.096941 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.097116 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.097259 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.097465 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.097785 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.097873 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.098137 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.098229 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.098464 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.098566 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.098787 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.098877 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.099095 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.099186 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.099417 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.099520 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.099724 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.099821 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.100030 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.100120 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.100344 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.100436 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.100655 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.100747 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.100958 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.101046 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.101265 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.101358 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.101575 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.101665 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.101882 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.102038 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.102211 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.102306 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.102521 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.102624 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.102824 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.102914 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.103133 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.103223 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.103444 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.103546 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.103751 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.103927 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.104057 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.104146 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.104366 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.104524 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.104736 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.104954 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.105045 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.105331 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.105467 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.105636 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.105739 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.105971 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.106079 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.106280 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.106378 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.106590 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.106680 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.106895 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.106992 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.107204 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.107294 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.107509 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.107608 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.107818 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.107910 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.108122 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.108265 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.108443 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.108592 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.108753 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.108893 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.109059 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.109220 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.109371 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.109536 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.109678 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.109863 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.110027 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.110217 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.110317 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.110532 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.110622 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.110859 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.110948 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.111173 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.111335 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.111504 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.111762 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.111853 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.112140 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.112275 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.112463 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.112555 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.112776 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.112865 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.113085 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.113183 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.113393 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.113491 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.113704 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.113794 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.114029 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.114135 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.114355 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.114447 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.114666 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.114755 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.114976 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.115076 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.115286 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.115376 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.115596 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.115685 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.115903 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.116006 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.116212 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.116303 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.116520 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.116609 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.116827 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.116918 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.117136 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.117225 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.117450 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.117540 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.117768 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.117858 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.118114 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.118204 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.118431 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.118520 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.118749 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.118848 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.119106 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.119210 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.119365 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.119453 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.119672 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.119763 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.119979 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.120631 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.120808 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.120909 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.121123 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.121385 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.121475 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.121713 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.121803 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.122067 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.122161 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.122387 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.122475 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.122709 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.122798 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.123044 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.123136 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.123363 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.123454 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.123684 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.123784 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.124000 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.124088 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.124312 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.124408 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.124619 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.124721 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.124939 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.125034 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.125245 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.125340 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.125572 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.125718 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.125901 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.126003 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.126250 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.126382 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.126573 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.126667 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.126877 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.126967 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.127181 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.127271 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.127487 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.127579 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.127795 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.127892 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.128122 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.128219 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.128452 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.128548 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.128700 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 07 18:36:25.128791 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.129064 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.129379 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.129701 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.130037 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.130359 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.130680 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.130992 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.131300 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.131630 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.131943 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.132255 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.132566 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.132877 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.133187 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.133495 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.133819 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.134169 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.134478 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.134801 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.135119 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.135439 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.136312 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.136630 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.136962 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.137276 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.137594 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.137946 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.138244 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.138563 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.138881 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.139215 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.139542 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.139868 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.140197 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.140542 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.140856 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.141202 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.141530 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.141846 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.142184 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.142492 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:36:25.142735 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 07 18:36:25.152240 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_db.sqlalchemy.engines [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.164929 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_db.sqlalchemy.engines [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.223644 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.context [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),334d5eb6-08fc-4490-ba4b-66711b77338f(cell1) {{(pid=108390) load_cells /opt/stack/nova/nova/context.py:464}} Dec 07 18:36:25.227876 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_concurrency.lockutils [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:36:25.231049 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_concurrency.lockutils [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:36:25.232036 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_concurrency.lockutils [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:36:25.233959 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_concurrency.lockutils [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:36:25.235177 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.context [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),334d5eb6-08fc-4490-ba4b-66711b77338f(cell1) {{(pid=108391) load_cells /opt/stack/nova/nova/context.py:464}} Dec 07 18:36:25.239660 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:36:25.241250 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:36:25.243615 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:36:25.245617 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_db.sqlalchemy.engines [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.246128 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:36:25.248336 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_db.sqlalchemy.engines [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.259929 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_db.sqlalchemy.engines [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.263671 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_db.sqlalchemy.engines [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.413794 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG oslo_db.sqlalchemy.engines [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.428234 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_db.sqlalchemy.engines [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:36:25.758459 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: WARNING keystonemiddleware.auth_token [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:36:25.765888 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: WARNING keystonemiddleware.auth_token [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:36:25.770722 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: WARNING keystonemiddleware.auth_token [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:36:25.777636 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: WARNING keystonemiddleware.auth_token [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:36:26.107126 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: WARNING keystonemiddleware.auth_token [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:36:26.112307 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: WARNING keystonemiddleware.auth_token [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:36:26.117442 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568d8abe9c0 pid: 108390 (default app) Dec 07 18:36:26.118575 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: WARNING keystonemiddleware.auth_token [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:36:26.119525 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:36:26.121315 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002238 Dec 07 18:36:26.121726 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Tue Dec 7 18:36:26 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:36:26.124417 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: WARNING keystonemiddleware.auth_token [None req-5193647c-fbb6-47b9-a95e-0d3faa1fe533 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:36:26.129494 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568d8abe9c0 pid: 108391 (default app) Dec 07 18:37:49.315819 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:37:49.317085 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001732 Dec 07 18:37:49.317843 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:37:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:37:49.758674 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-d7cf85a1-2ad4-4617-9806-b8d89bbbf315 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:37:49.789060 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-d7cf85a1-2ad4-4617-9806-b8d89bbbf315 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.463530 Dec 07 18:37:49.790225 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Dec 7 18:37:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:37:52.244376 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:37:52.245311 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-ff3c2cff-765a-4846-98be-83f8052cf111 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Dec 07 18:37:52.245848 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:37:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:37:52.313129 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-80f71100-ad93-41c2-8a13-b09f22928d02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:37:52.331541 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:37:52.331541 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: warnings.warn(msg) Dec 07 18:37:52.362255 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-80f71100-ad93-41c2-8a13-b09f22928d02 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110089 Dec 07 18:37:52.363869 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:37:52 2021] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:37:52.586530 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-8037eb43-67d9-4ccc-a4fa-8bf84032a43e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:37:52.589071 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:37:52.589071 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: warnings.warn(msg) Dec 07 18:37:52.640418 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-8037eb43-67d9-4ccc-a4fa-8bf84032a43e admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.267653 Dec 07 18:37:52.641951 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Dec 7 18:37:52 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:37:55.057172 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-80f71100-ad93-41c2-8a13-b09f22928d02 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:37:55.058630 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-80f71100-ad93-41c2-8a13-b09f22928d02 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001897 Dec 07 18:37:55.059034 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:37:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:37:55.178723 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-939eb48d-7f3e-4208-ba8d-41621c370ee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "name": "ds512M"}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:37:55.198644 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:37:55.198644 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: warnings.warn(msg) Dec 07 18:37:55.220616 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-939eb48d-7f3e-4208-ba8d-41621c370ee7 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154922 Dec 07 18:37:55.221176 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:37:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:37:55.235158 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-3ecae361-06b2-451d-82c8-f2be8d2dc93b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:37:55.236590 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:37:55.236590 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: warnings.warn(msg) Dec 07 18:37:55.277800 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-3ecae361-06b2-451d-82c8-f2be8d2dc93b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046954 Dec 07 18:37:55.278715 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Dec 7 18:37:55 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:37:57.685234 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-939eb48d-7f3e-4208-ba8d-41621c370ee7 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:37:57.686291 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-939eb48d-7f3e-4208-ba8d-41621c370ee7 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 07 18:37:57.686710 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:37:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:37:57.743752 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-36e1924b-ec53-467c-8adc-8075074bdccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:37:57.764359 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-36e1924b-ec53-467c-8adc-8075074bdccb admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071241 Dec 07 18:37:57.765231 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:37:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:37:57.777215 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-59a4762c-9dd0-4a62-bb3c-133f52eb96b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:37:57.800513 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-59a4762c-9dd0-4a62-bb3c-133f52eb96b2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027134 Dec 07 18:37:57.801088 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Dec 7 18:37:57 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:38:00.260573 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-36e1924b-ec53-467c-8adc-8075074bdccb admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:00.261610 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-36e1924b-ec53-467c-8adc-8075074bdccb admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Dec 07 18:38:00.262131 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:00.320863 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-afb004af-063f-481a-a179-6eb074bd337b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "vcpus": 2}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:00.340197 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-afb004af-063f-481a-a179-6eb074bd337b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071573 Dec 07 18:38:00.340740 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:38:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:38:00.353683 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-ad53893b-ce5d-4be4-b47d-4ce603cb65a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:00.375734 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-ad53893b-ce5d-4be4-b47d-4ce603cb65a8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026258 Dec 07 18:38:00.376300 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Dec 7 18:38:00 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:38:02.800289 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-afb004af-063f-481a-a179-6eb074bd337b admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:02.801282 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-afb004af-063f-481a-a179-6eb074bd337b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Dec 07 18:38:02.801680 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:02.862244 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-9b3c4c8e-39d1-427b-beda-8cb18716111d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:02.880932 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-9b3c4c8e-39d1-427b-beda-8cb18716111d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071937 Dec 07 18:38:02.881480 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:38:02 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:38:02.894123 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-50d645d7-451b-403f-a999-0981122429d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:02.917526 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-50d645d7-451b-403f-a999-0981122429d2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026935 Dec 07 18:38:02.918135 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Tue Dec 7 18:38:02 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:38:05.391073 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-9b3c4c8e-39d1-427b-beda-8cb18716111d admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:05.392391 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-9b3c4c8e-39d1-427b-beda-8cb18716111d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001897 Dec 07 18:38:05.392938 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:38:05.472478 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-7e61137e-4981-4ba7-8dce-00ccaa576321 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:05.497283 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-7e61137e-4981-4ba7-8dce-00ccaa576321 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.096858 Dec 07 18:38:05.497827 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Dec 7 18:38:05 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:38:07.954974 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-9b3c4c8e-39d1-427b-beda-8cb18716111d admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:07.955970 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-9b3c4c8e-39d1-427b-beda-8cb18716111d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Dec 07 18:38:07.956375 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:08.017261 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-7eb38e9e-9e4b-4e11-8df0-4a381d8b4d69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:08.041057 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-7eb38e9e-9e4b-4e11-8df0-4a381d8b4d69 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076975 Dec 07 18:38:08.041950 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:38:07 2021] POST /compute/v2.1/flavors => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:38:08.054192 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-c046bd30-3ba8-49a0-b4be-56e49a2f4ba4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:08.078380 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-c046bd30-3ba8-49a0-b4be-56e49a2f4ba4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027942 Dec 07 18:38:08.078946 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Dec 7 18:38:08 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:38:10.498658 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-7eb38e9e-9e4b-4e11-8df0-4a381d8b4d69 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:10.499658 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-7eb38e9e-9e4b-4e11-8df0-4a381d8b4d69 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 07 18:38:10.500224 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:10.559635 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-26f785df-6c68-4e13-acbd-f5b721486344 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:10.579417 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-26f785df-6c68-4e13-acbd-f5b721486344 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072544 Dec 07 18:38:10.579971 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:38:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:38:10.592358 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-d699c93a-52eb-40d6-b0bf-177aa9d48ac8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:10.615092 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-d699c93a-52eb-40d6-b0bf-177aa9d48ac8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026304 Dec 07 18:38:10.615670 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Dec 7 18:38:10 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:38:13.068379 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-26f785df-6c68-4e13-acbd-f5b721486344 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:13.069554 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-26f785df-6c68-4e13-acbd-f5b721486344 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001625 Dec 07 18:38:13.070102 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:13.128236 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-bb67fb51-73c3-4f7c-9582-49055c34f308 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "disk": 40}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:13.145881 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-bb67fb51-73c3-4f7c-9582-49055c34f308 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069098 Dec 07 18:38:13.146522 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:38:13 2021] POST /compute/v2.1/flavors => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:38:13.159379 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-f53464e8-f945-49df-8623-90df86cc841d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:13.182290 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-f53464e8-f945-49df-8623-90df86cc841d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026433 Dec 07 18:38:13.183295 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Dec 7 18:38:13 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:38:15.685035 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-bb67fb51-73c3-4f7c-9582-49055c34f308 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:15.685985 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-bb67fb51-73c3-4f7c-9582-49055c34f308 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Dec 07 18:38:15.686585 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:15.752319 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-4a0c1fc4-19a1-4191-85aa-4a7073ac5232 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "swap": 0}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:15.774932 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-4a0c1fc4-19a1-4191-85aa-4a7073ac5232 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082002 Dec 07 18:38:15.775490 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:38:15 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:38:15.787684 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-51393f11-1fb1-475d-8e4f-26a73dd4c898 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:15.814436 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-51393f11-1fb1-475d-8e4f-26a73dd4c898 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030173 Dec 07 18:38:15.815259 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Dec 7 18:38:15 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:38:18.274656 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-4a0c1fc4-19a1-4191-85aa-4a7073ac5232 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:18.275663 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-4a0c1fc4-19a1-4191-85aa-4a7073ac5232 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 07 18:38:18.278295 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:18 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:38:18.343101 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-a240a0fd-a70c-4c96-a4ad-d3d76dae28db admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "swap": 0, "rxtx_factor": 1.0}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:18.362210 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-a240a0fd-a70c-4c96-a4ad-d3d76dae28db admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079481 Dec 07 18:38:18.370695 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Tue Dec 7 18:38:18 2021] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:38:18.375275 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-050cfad0-349a-43cd-91e9-c3be8e50aaac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:18.414070 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-050cfad0-349a-43cd-91e9-c3be8e50aaac admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041331 Dec 07 18:38:18.415789 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Tue Dec 7 18:38:18 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:38:39.694433 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-a240a0fd-a70c-4c96-a4ad-d3d76dae28db admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:39.696148 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-a240a0fd-a70c-4c96-a4ad-d3d76dae28db admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 07 18:38:39.696600 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:38:39 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:39.753889 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-d55fd76b-c9ab-462f-b5e8-f3bb3f324bbd admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:39.770717 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-d55fd76b-c9ab-462f-b5e8-f3bb3f324bbd admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067569 Dec 07 18:38:39.771244 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Dec 7 18:38:39 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:38:41.379471 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-a240a0fd-a70c-4c96-a4ad-d3d76dae28db admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:41.380521 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-a240a0fd-a70c-4c96-a4ad-d3d76dae28db admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Dec 07 18:38:41.380918 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:41.570599 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-54ecdbe5-dbbe-439a-9e39-fec9c5933b92 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:41.576154 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.wsgi [None req-54ecdbe5-dbbe-439a-9e39-fec9c5933b92 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 07 18:38:41.576724 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-54ecdbe5-dbbe-439a-9e39-fec9c5933b92 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:38:41.577523 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-54ecdbe5-dbbe-439a-9e39-fec9c5933b92 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059046 Dec 07 18:38:41.578072 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Dec 7 18:38:41 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 07 18:38:41.588335 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-2037ea2f-f3b6-4dcf-9942-c265e65283c1 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:41.609172 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-2037ea2f-f3b6-4dcf-9942-c265e65283c1 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025118 Dec 07 18:38:41.609704 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Dec 7 18:38:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:38:41.619916 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-abe07ae6-11a4-4341-b809-cd15e5df3b3c admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:41.640172 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-abe07ae6-11a4-4341-b809-cd15e5df3b3c admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023816 Dec 07 18:38:41.640707 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Dec 7 18:38:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:38:41.650950 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-0443d860-5bf8-4c74-9f3f-7b58499415da admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:41.656279 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.wsgi [None req-0443d860-5bf8-4c74-9f3f-7b58499415da admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 07 18:38:41.656841 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-0443d860-5bf8-4c74-9f3f-7b58499415da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:38:41.657615 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-0443d860-5bf8-4c74-9f3f-7b58499415da admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010679 Dec 07 18:38:41.658130 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Dec 7 18:38:41 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 07 18:38:43.181660 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-abe07ae6-11a4-4341-b809-cd15e5df3b3c admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:43.182938 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-abe07ae6-11a4-4341-b809-cd15e5df3b3c admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Dec 07 18:38:43.183323 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:43.372855 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-d83a3a5e-fbb0-45fc-86fe-7b7c7e3d4841 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:43.378488 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.wsgi [None req-d83a3a5e-fbb0-45fc-86fe-7b7c7e3d4841 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 07 18:38:43.379046 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-d83a3a5e-fbb0-45fc-86fe-7b7c7e3d4841 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:38:43.379965 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-d83a3a5e-fbb0-45fc-86fe-7b7c7e3d4841 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057027 Dec 07 18:38:43.380464 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Dec 7 18:38:43 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 07 18:38:43.390637 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-71815b3d-124b-40e2-b848-f568162e81b8 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:43.404466 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-71815b3d-124b-40e2-b848-f568162e81b8 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017437 Dec 07 18:38:43.404979 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Dec 7 18:38:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:38:43.415418 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-07c7700c-f5ee-4a74-bda3-1f113b0d897b admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:43.428828 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-07c7700c-f5ee-4a74-bda3-1f113b0d897b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017412 Dec 07 18:38:43.429616 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Dec 7 18:38:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:38:43.440230 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-3ac39cec-4ac8-40fe-9702-da51b2242f76 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:43.446094 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.wsgi [None req-3ac39cec-4ac8-40fe-9702-da51b2242f76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 07 18:38:43.446652 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-3ac39cec-4ac8-40fe-9702-da51b2242f76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:38:43.447419 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-3ac39cec-4ac8-40fe-9702-da51b2242f76 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011087 Dec 07 18:38:43.447899 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Tue Dec 7 18:38:43 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 07 18:38:44.962344 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-07c7700c-f5ee-4a74-bda3-1f113b0d897b admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:44.963348 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-07c7700c-f5ee-4a74-bda3-1f113b0d897b admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Dec 07 18:38:44.963747 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:45.155938 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-63be6b56-0689-4149-b199-87505df6621b admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:45.161166 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.wsgi [None req-63be6b56-0689-4149-b199-87505df6621b admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 07 18:38:45.161731 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-63be6b56-0689-4149-b199-87505df6621b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:38:45.162554 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-63be6b56-0689-4149-b199-87505df6621b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060108 Dec 07 18:38:45.163055 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Dec 7 18:38:45 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 07 18:38:45.173410 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-8dee87a8-aaaa-40ce-a8a7-16a687c5b0f5 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:45.186981 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-8dee87a8-aaaa-40ce-a8a7-16a687c5b0f5 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017102 Dec 07 18:38:45.187559 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Dec 7 18:38:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:38:45.200176 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:45.213865 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019582 Dec 07 18:38:45.214425 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Tue Dec 7 18:38:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:38:45.224111 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-bbed7fa2-618f-452f-83dd-c92e20b32787 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:45.229520 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.wsgi [None req-bbed7fa2-618f-452f-83dd-c92e20b32787 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 07 18:38:45.230127 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-bbed7fa2-618f-452f-83dd-c92e20b32787 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:38:45.230909 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-bbed7fa2-618f-452f-83dd-c92e20b32787 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010354 Dec 07 18:38:45.231397 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Dec 7 18:38:45 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 07 18:38:46.726440 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:46.727436 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Dec 07 18:38:46.727823 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:38:46.917618 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-81e0692f-8fbe-459c-8e17-708d4f6ff233 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:46.936749 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-81e0692f-8fbe-459c-8e17-708d4f6ff233 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068811 Dec 07 18:38:46.937218 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Dec 7 18:38:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:38:48.414778 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:48.415790 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 Dec 07 18:38:48.416187 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:48.609186 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-baa4fc57-9355-41b1-a12a-629ba5f1ceed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:48.626641 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-baa4fc57-9355-41b1-a12a-629ba5f1ceed admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067990 Dec 07 18:38:48.627098 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Dec 7 18:38:48 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:38:50.141306 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:50.142345 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Dec 07 18:38:50.142743 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:50.335145 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-3d48c505-d68c-4fa7-872f-577f85bb701f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:50.353109 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-3d48c505-d68c-4fa7-872f-577f85bb701f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069652 Dec 07 18:38:50.353550 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Dec 7 18:38:50 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:38:51.845840 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:51.846872 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Dec 07 18:38:51.847269 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:52.040136 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-71b28313-36fc-447c-bfc7-3ae014fdcb9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:38:52.058264 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-71b28313-36fc-447c-bfc7-3ae014fdcb9a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069921 Dec 07 18:38:52.058736 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Tue Dec 7 18:38:51 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:38:53.591798 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:53.592827 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 07 18:38:53.593219 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:38:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:38:53.782729 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-e7c94997-7694-4c28-8832-eefc5324b14b admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:38:53.801738 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-e7c94997-7694-4c28-8832-eefc5324b14b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069706 Dec 07 18:38:53.802295 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Tue Dec 7 18:38:53 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:39:41.891898 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:39:41.892889 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-8f68a72e-e590-4eee-bfd4-9532182225c0 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Dec 07 18:39:41.893284 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Tue Dec 7 18:39:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:39:41.951409 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-03f4ba56-4d80-49d4-80ed-f4241ec258e6 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:39:41.971070 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-03f4ba56-4d80-49d4-80ed-f4241ec258e6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070488 Dec 07 18:39:41.971604 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Tue Dec 7 18:39:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:39:41.994118 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-cbaed4e2-9377-483b-a3a9-959222d1659d admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:39:42.001736 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-cbaed4e2-9377-483b-a3a9-959222d1659d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011675 Dec 07 18:39:42.002287 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Dec 7 18:39:41 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:39:42.015056 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-645355c8-664f-448e-8a46-99c48c14e870 admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:39:42.023587 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-645355c8-664f-448e-8a46-99c48c14e870 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011733 Dec 07 18:39:42.024366 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Dec 7 18:39:42 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:39:42.036453 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-cf33f887-2e1e-48e3-bfc2-031c98d53896 admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:39:42.044403 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-cf33f887-2e1e-48e3-bfc2-031c98d53896 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011815 Dec 07 18:39:42.044927 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Tue Dec 7 18:39:42 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:39:42.057283 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:39:42.065131 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012172 Dec 07 18:39:42.065654 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Tue Dec 7 18:39:42 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:41:08.074966 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-dd7d5c22-7aab-432a-8a5a-56d6b556e73d tempest-verify_tempest_config-1384179008 tempest-verify_tempest_config-1384179008-project] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:41:08.076950 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-dd7d5c22-7aab-432a-8a5a-56d6b556e73d tempest-verify_tempest_config-1384179008 tempest-verify_tempest_config-1384179008-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104771 Dec 07 18:41:08.077482 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 34/69] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Dec 7 18:41:07 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:42:33.486882 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:33.487897 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Dec 07 18:42:33.488293 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 36/70] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:42:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:42:33.749465 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-5e8a8f03-1d7c-4a9f-bf68-3133043dc80c admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:33.750649 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:42:33.750649 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: warnings.warn(msg) Dec 07 18:42:33.752163 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5e8a8f03-1d7c-4a9f-bf68-3133043dc80c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:33.752598 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5e8a8f03-1d7c-4a9f-bf68-3133043dc80c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:33.753407 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5e8a8f03-1d7c-4a9f-bf68-3133043dc80c admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:33.753828 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-5e8a8f03-1d7c-4a9f-bf68-3133043dc80c admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:33.791722 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-5e8a8f03-1d7c-4a9f-bf68-3133043dc80c admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155753 Dec 07 18:42:33.792486 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 35/71] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Dec 7 18:42:33 2021] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:42:35.356226 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:35.357230 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Dec 07 18:42:35.357626 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 37/72] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:42:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:42:35.551673 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-044e7812-03ea-4540-ac20-ea241d8af7fc admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:35.552871 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:42:35.552871 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: warnings.warn(msg) Dec 07 18:42:35.554417 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-044e7812-03ea-4540-ac20-ea241d8af7fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:35.555162 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-044e7812-03ea-4540-ac20-ea241d8af7fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:35.556589 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-044e7812-03ea-4540-ac20-ea241d8af7fc admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:35.557016 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-044e7812-03ea-4540-ac20-ea241d8af7fc admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:35.581761 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-044e7812-03ea-4540-ac20-ea241d8af7fc admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080773 Dec 07 18:42:35.582272 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 36/73] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Dec 7 18:42:35 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:42:47.533432 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:47.534464 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Dec 07 18:42:47.534860 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 38/74] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:42:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:42:47.729822 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-0ca32c00-7c6c-4f7d-8cd0-05d8aa18652d admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:47.731012 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:42:47.731012 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: warnings.warn(msg) Dec 07 18:42:47.732558 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-0ca32c00-7c6c-4f7d-8cd0-05d8aa18652d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:47.732999 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-0ca32c00-7c6c-4f7d-8cd0-05d8aa18652d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:47.733843 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-0ca32c00-7c6c-4f7d-8cd0-05d8aa18652d admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:47.734294 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-0ca32c00-7c6c-4f7d-8cd0-05d8aa18652d admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:47.755259 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-0ca32c00-7c6c-4f7d-8cd0-05d8aa18652d admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076442 Dec 07 18:42:47.755798 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 37/75] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Dec 7 18:42:47 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:42:49.267729 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: DEBUG nova.api.openstack.wsgi [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] Calling method '>' {{(pid=108390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:49.268717 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: INFO nova.api.openstack.requestlog [None req-48c1ceb3-fe68-4201-add5-548fbf054e6d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Dec 07 18:42:49.269104 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: [pid: 108390|app: 0|req: 39/76] 10.222.0.41 () {56 vars in 1074 bytes} [Tue Dec 7 18:42:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:42:49.469477 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG nova.api.openstack.wsgi [None req-60a2fd1b-3ee8-456f-943c-ee77c1feb54f admin admin] Calling method '>' {{(pid=108391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:42:49.470657 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:42:49.470657 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: warnings.warn(msg) Dec 07 18:42:49.472155 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-60a2fd1b-3ee8-456f-943c-ee77c1feb54f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:49.472590 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-60a2fd1b-3ee8-456f-943c-ee77c1feb54f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:49.473372 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-60a2fd1b-3ee8-456f-943c-ee77c1feb54f admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:42:49.473792 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: DEBUG oslo_concurrency.lockutils [None req-60a2fd1b-3ee8-456f-943c-ee77c1feb54f admin admin] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:42:49.495387 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: INFO nova.api.openstack.requestlog [None req-60a2fd1b-3ee8-456f-943c-ee77c1feb54f admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077737 Dec 07 18:42:49.495863 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: [pid: 108391|app: 0|req: 38/77] 10.222.0.41 () {60 vars in 1193 bytes} [Tue Dec 7 18:42:49 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:43:46.257242 dv-cinder-819692-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 07 18:43:46.257864 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: Tue Dec 7 18:43:46 2021 - graceful shutdown triggered... Dec 07 18:43:46.258334 dv-cinder-819692-6-iscsi devstack@n-api.service[108391]: Gracefully killing worker 2 (pid: 108391)... Dec 07 18:43:46.258684 dv-cinder-819692-6-iscsi devstack@n-api.service[108390]: Gracefully killing worker 1 (pid: 108390)... Dec 07 18:43:47.258031 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: worker 1 buried after 1 seconds Dec 07 18:43:47.258482 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: worker 2 buried after 1 seconds Dec 07 18:43:47.258482 dv-cinder-819692-6-iscsi devstack@n-api.service[108389]: goodbye to uWSGI. Dec 07 18:43:47.259606 dv-cinder-819692-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 07 18:43:47.260710 dv-cinder-819692-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 07 18:43:47.263552 dv-cinder-819692-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 07 18:43:47.273278 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Dec 7 18:43:47 2021] *** Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: nodename: dv-cinder-819692-6-iscsi Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: machine: x86_64 Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: clock source: unix Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: pcre jit disabled Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: detected number of CPU cores: 4 Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: current working directory: / Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: detected binary path: /usr/bin/uwsgi-core Dec 07 18:43:47.275306 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: your processes number limit is 47680 Dec 07 18:43:47.276778 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: your memory page size is 4096 bytes Dec 07 18:43:47.276778 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: detected max file descriptor number: 2048 Dec 07 18:43:47.276778 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: lock engine: pthread robust mutexes Dec 07 18:43:47.276778 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: thunder lock: enabled Dec 07 18:43:47.276778 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 07 18:43:47.276778 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 07 18:43:47.321833 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: Python main interpreter initialized at 0x5647ab0a79c0 Dec 07 18:43:47.321833 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: python threads support enabled Dec 07 18:43:47.321833 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: your server socket listen backlog is limited to 100 connections Dec 07 18:43:47.321833 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: your mercy for graceful operations on workers is 90 seconds Dec 07 18:43:47.322248 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: mapped 403077 bytes (393 KB) for 2 cores Dec 07 18:43:47.322324 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: *** Operational MODE: preforking *** Dec 07 18:43:47.322689 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: *** uWSGI is running in multiple interpreter mode *** Dec 07 18:43:47.322689 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: spawned uWSGI master process (pid: 122567) Dec 07 18:43:47.323445 dv-cinder-819692-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 07 18:43:47.324609 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: spawned uWSGI worker 1 (pid: 122585, cores: 1) Dec 07 18:43:47.324609 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: spawned uWSGI worker 2 (pid: 122586, cores: 1) Dec 07 18:43:47.324609 dv-cinder-819692-6-iscsi devstack@n-api.service[122567]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 07 18:43:49.226442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:43:49.226442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: from cryptography.utils import int_from_bytes Dec 07 18:43:49.227160 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:43:49.227160 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: from cryptography.utils import int_from_bytes Dec 07 18:43:49.230328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:43:49.230328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: from cryptography.utils import int_from_bytes Dec 07 18:43:49.230816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 07 18:43:49.230816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: from cryptography.utils import int_from_bytes Dec 07 18:43:51.685080 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 07 18:43:51.686278 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 07 18:43:51.687430 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 07 18:43:51.687430 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 07 18:43:51.687430 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 07 18:43:51.687967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.688457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.688457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.688938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.689077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.689299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.691201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.691732 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.692076 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.692344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.692666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.693003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819692-6-iscsi {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.693332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.693647 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.693986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.694314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.694619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.694948 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.695257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.695772 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.696511 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.697075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.697629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.697998 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.698493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.698987 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.699367 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.699619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.700110 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.700568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.701128 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819692-6-iscsi {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.701459 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.701784 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.702151 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.702565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.702883 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.703201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.703535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.703875 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.704190 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.704525 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.704852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.705176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.705499 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.705806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.706137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.706453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.706778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.707086 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.707392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.707645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.707954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.708276 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.708777 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.709112 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.709368 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.709621 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.709966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.710290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.710607 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.710908 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.711223 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.711536 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.711845 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.712152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.712460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.712769 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.713130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.713456 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.713782 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.714137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.714460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.714866 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.715121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.715430 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.715788 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.716096 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.716403 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.716882 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.717211 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.717527 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.717835 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.718181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.718503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.718844 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.719150 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.719403 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.719706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.720013 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.720335 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.720649 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.720958 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.721264 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.722209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.722209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.722209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.722740 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.722902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.723113 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.723625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.723786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.724017 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.724325 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.724648 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.724972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.725284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.725593 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.725901 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.726236 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.726581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.726871 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.727181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.727505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.727812 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.728120 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.728440 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.729289 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.729596 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.730016 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.730257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.730568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.730892 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.731202 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.731509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.731812 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.732116 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.732418 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.732722 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.733028 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.733337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.733636 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.733975 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.734309 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.735613 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.735613 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.735613 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.735613 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.736252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.736252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.736550 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.736807 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.737144 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.737479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.737800 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.738219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.738537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.738867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.739181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.739496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.739809 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.740132 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.740455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.740785 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.741105 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.741421 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.741743 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.742077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.742398 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.742729 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.743053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.743373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.743718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.744063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.745110 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.745381 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.745710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.746148 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.746335 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.746656 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.746978 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.747327 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.747646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.747964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.748303 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.748628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.748948 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.749258 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.749570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.749880 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.750217 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.750526 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.750850 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.751524 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.751524 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.751849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.752360 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.752544 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.752706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.753013 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.753722 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.753722 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.754075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.754267 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.754580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.754888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.755213 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.755522 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.755827 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.756143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.756454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.756766 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.757078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.757488 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.757763 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.758064 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.758361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.758692 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.758998 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.759326 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.759654 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.760076 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.760453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.761063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.761063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.761465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.761614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.761897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.762266 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.762530 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.762835 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.764154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.764154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.764154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.764154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.764854 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.764854 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.765383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.765383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.765657 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.765964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.766309 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.766635 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.766964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.767283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.767640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.767939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.768237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.768532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.768848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.769174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.769492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.769816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.770229 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.770561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.770878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.771203 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.771513 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.771825 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.772168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.772507 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.772811 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.773143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.773458 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.773776 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.774115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.774431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.774746 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.775060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.775382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.776229 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.776820 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.777003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.777173 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.777489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.777831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.778280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.778692 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.778863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.779291 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.779611 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.779927 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.780249 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.780562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.780872 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.781185 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.781494 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.781802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.782141 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.782460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.782771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.783082 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.783385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.783707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.784016 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.784323 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.784626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.784941 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.785265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.785577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.785900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.786261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.786569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.786874 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.787199 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.787510 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.787817 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.788121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.788428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.788775 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.789086 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.789392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.789710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.790056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.790372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.790690 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.791001 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.791914 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.792239 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.792555 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.792867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.793182 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.793494 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.793810 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.794149 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.794473 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.794783 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.795096 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.795408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.795713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.796027 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.796343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.796920 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.797255 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.797572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.797893 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.798238 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.798560 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.798893 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.799222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.799539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.799849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.800157 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.800517 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.801476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.801476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.801476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.801758 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.802200 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.802399 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.802714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.803002 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.803337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.803649 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.804046 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 07 18:43:51.804533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.804689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 07 18:43:51.804841 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.804991 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 07 18:43:51.805141 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.806227 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 07 18:43:51.806336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.806424 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 07 18:43:51.806516 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.806606 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.806700 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.806848 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.807043 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.807149 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.807242 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.807335 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.807420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.807420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.807420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.807637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.807743 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.807930 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.808098 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.808254 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.808398 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.808580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.808722 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.808920 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.809060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.809202 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.809330 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.809499 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.809637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.809832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819692-6-iscsi {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.810005 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.811042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.811195 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.811340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.811661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.811810 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.812034 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.812214 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.812418 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.812600 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.812782 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.812940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.813097 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.813249 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.813391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.813391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.813677 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.813849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.814016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.814171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.814322 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.814479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.814629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.814781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.814924 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.815074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.815216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.815363 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.815505 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.815655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.815806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.815948 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.816089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.816237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.816398 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.816547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.816689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.816830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.816979 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819692-6-iscsi {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.817147 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.817302 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.817445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.817445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.817713 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.817861 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.818056 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.818200 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.818362 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.818513 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.818656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.818796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.818948 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.819090 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.819232 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.819381 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.819523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.819673 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.819816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.819965 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.820117 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.820259 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.820407 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.820558 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.820701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.820850 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.821001 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.821143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.821294 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.821450 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.821612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.821763 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.821923 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.822091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.822242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.822436 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.822647 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.822928 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.823201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.823359 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.823512 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.823655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.823797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.823938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.823938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.823938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.824376 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.824531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.824680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.824830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.824981 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.825129 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.825285 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.825438 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.825590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.825733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.825883 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.826072 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.826219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.826369 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.826521 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.826664 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.826814 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.826969 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.827112 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.827263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.827406 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.827547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.827691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.827846 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.827999 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.828149 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.828300 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.828442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.828594 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.828743 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.828895 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.829044 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.829195 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.829338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.829489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.829631 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.829774 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.829958 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.830119 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.830263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.830420 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.830564 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.830705 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.830846 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.830988 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.831136 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.831288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.831439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.831589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.831748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.831893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.832048 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.832048 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.832328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.832478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.832629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.832629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.832914 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.833057 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.833204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.833347 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.833489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.833489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.833779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.833941 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.834101 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.834251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.834402 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.834402 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.834693 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.834837 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.834978 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.835127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.835269 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.835418 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.835583 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.835727 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.835867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.836008 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.836156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.836313 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.836463 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.836612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.836762 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.836913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.837054 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.837204 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.837346 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.837504 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.837654 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.837797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.838805 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.838982 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.839128 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.839271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.839412 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.839555 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.839697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.839697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.839697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.840113 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.840273 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.840416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.840641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.840788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.840931 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.841079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.841221 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.841363 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.841512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.841656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.841796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.841968 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.842127 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.842270 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.842435 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.842589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.842739 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.842891 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.843042 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.843193 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.843349 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.843499 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.843655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.843819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.843974 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.844144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.844292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.844449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.844606 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.844756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.844903 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.845061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.845210 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.845370 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.845529 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.845686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.845842 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.846024 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.846193 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.846371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.846544 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.846702 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.846851 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.847000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.847148 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.847306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.847455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.847603 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.847750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.847907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.847907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.848210 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.848360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.848516 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.848665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.848813 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.848969 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.849126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.849284 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.849434 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.849588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.849737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.849898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.850124 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.850275 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.850422 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.850577 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.850732 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.850889 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 07 18:43:51.851039 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.851186 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.851344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.851499 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.851655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.851655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.851960 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.852119 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.852268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.852426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.852583 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.852742 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.852892 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.853052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.853211 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.853366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.853524 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.853720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.854424 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.854599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.854703 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.854703 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.854894 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.854894 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.855101 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.855197 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.855309 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.855624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.855733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.855952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.856143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.856297 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.856628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.856731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.856956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.857046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.857271 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.857377 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.857585 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.857774 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.857950 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.858107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.858256 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.858416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.858567 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.858737 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.858896 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.859052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.859208 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.859366 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.859523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.859681 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.859831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.859987 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.860136 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.860284 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.860446 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.860602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.860763 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.860911 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.861059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.861206 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.861367 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.861523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.861679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.861830 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.862064 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.862225 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.862387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.862544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.862710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.862867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.863023 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.863179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.863340 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.863340 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.863630 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.863778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.863927 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.864087 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.864253 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.864403 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.864559 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.864718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.864867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.864867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.865167 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.865324 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.865480 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.865636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.865816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.866132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.866289 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.866446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.866596 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.866744 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.866903 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.867062 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.867211 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.867360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.867516 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.867665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.867822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.867822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.868106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.868261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.868417 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.868565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.868721 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.868882 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.869032 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.869187 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.869440 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.869601 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.869760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.869957 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.869957 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.870264 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.870413 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.870569 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.870728 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.870895 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.871059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.871208 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.871357 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.871514 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.871664 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.871812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.871968 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.872117 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.872265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.872422 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.872578 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.872735 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.872902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.873062 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.873218 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.873381 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.873531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.873687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.873836 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.874005 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.874164 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.874329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.874479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.874700 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.874859 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.875019 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.875181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.875331 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.875480 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.875628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.875776 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.875931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.876089 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.876244 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.876393 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.876548 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.876697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.876853 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.877024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.877181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.877331 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.877479 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.877627 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.877783 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.877957 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.878122 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.878278 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.878427 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.878582 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.878745 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.878903 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.879053 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.879053 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.879344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.879500 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.879662 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.879885 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.880035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.880183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.880330 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.880330 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.880624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.880781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.880940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.881088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.881243 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.881399 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.881561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.881718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.881875 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.882076 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.882237 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.882396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.882552 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.882702 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.882869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.883018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.883173 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.883331 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.883488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.883637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.883792 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.883952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.884111 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.884269 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.884419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.884566 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.884714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.884921 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.885227 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.885390 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.885540 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.885688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.885845 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.886030 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.886195 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.886349 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.886506 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.886659 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.886814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.886983 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.887142 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.887290 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.887438 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.887593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.887741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.887898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.888047 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.888203 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.888352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.888500 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.888654 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.888812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.888971 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.889128 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.889283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.889433 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.889587 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.889746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.889894 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.890086 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.890236 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.890392 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.890540 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.890697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.890863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.891013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.891161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.891308 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.891465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.891613 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.891761 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.891909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.892063 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.892219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.892381 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.892537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.892685 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.892848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.892996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.893144 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.893301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.893456 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.893611 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.893760 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.893934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.894101 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.894260 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.894416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.894565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.894713 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.894878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.895154 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.895313 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.895470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.895626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.895776 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.895923 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.896084 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.896240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.896389 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.896537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.896683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.896683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.896992 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.897150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.897298 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.897446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.897602 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.897750 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.897954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.898123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.898273 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.898422 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.898570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.898731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.898890 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.899038 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.899193 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.899350 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.899505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.899664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.899820 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.899968 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.900115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.900270 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.900417 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.901169 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.901336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.901496 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.901646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.901802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.901972 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.902139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.902296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.902445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.902593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.902741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.902897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.903045 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.903200 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.903354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.903519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.903668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.903834 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.903991 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.904147 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.904301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.904462 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.904618 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.904775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.904924 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.905071 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.905225 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.905390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.905545 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.905702 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.905858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.906035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.906184 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.906343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.906511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.906659 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.906806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.906954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.907108 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.907256 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.907428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.907591 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.907740 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.907895 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.908044 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.908191 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.908352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.908500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.908655 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.908804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.908951 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.909105 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.909262 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.909432 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.909580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.909733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.909882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.910103 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.910261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.910416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.910572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.910721 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.910874 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.911031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.911031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.911328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.911487 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.911641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.911789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.911946 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.912104 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.912263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.912412 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.912596 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.912752 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.912937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.913092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.913241 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.913399 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.913556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.913705 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.913860 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.914051 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.914202 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.914369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.914532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.914682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.914830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.914977 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.915132 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.915294 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.915461 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.915617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.915773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.915928 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.916083 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.916785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.916949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.917157 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.917380 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.917535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.917691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.917953 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.918124 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.918284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.918444 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.918598 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.918747 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.918904 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.919063 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.919211 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.919372 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.919523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.919679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.919828 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.919986 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.920151 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.920311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.920466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.920623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.920771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.920919 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.921072 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.921230 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.921386 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.921544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.921700 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.921856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.922047 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.922216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.922365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.922521 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.922671 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.922828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.922989 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.923139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.923300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.923450 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.923597 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.923754 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.923910 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.924077 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.924225 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.924390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.924547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.924705 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.924855 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.925010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.925158 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.925305 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.925452 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.925608 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.925756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.925956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.926123 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.926283 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.926431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.926589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.926737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.926886 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.927040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.927190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.927337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.927493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.927648 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.927798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.927962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.928118 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.928280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.928437 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.928594 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.928743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.929148 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.929306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.929468 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.929625 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.929774 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.929950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.930116 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.930276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.930438 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.930588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.930743 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.930899 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.931049 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.931197 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.931357 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.931506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.931661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.931852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.932004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.932169 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.932337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.932337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.932635 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.932789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.932938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.933100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.933250 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.933406 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.933561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.933717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.933865 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.934077 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.934256 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.934414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.934569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.934718 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.934878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.935035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.935191 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.935341 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.935489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.935648 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.935805 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.935954 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.936180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.936343 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.936491 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.936646 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.936804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.936954 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.937101 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.937256 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.937412 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.937561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.937717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.937875 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.938058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.938220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.938369 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.938525 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.938688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.938838 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.938838 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.939124 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.939280 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.939439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.939595 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.939750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.939907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.940063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.940222 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.940379 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.940536 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.940685 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.940832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.940979 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.941136 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.941360 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.941512 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.941660 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.941807 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.941981 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 07 18:43:51.942151 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.942151 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.942495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.942811 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.943134 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.943458 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.943779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.944099 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.944419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.944728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.945052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.945371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.945722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.946055 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.946368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.946698 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.947017 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.947336 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.948177 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.948519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.948855 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.949169 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.949488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.949811 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.950155 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.950477 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.950795 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.951123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.951442 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.951762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.952082 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.952403 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.952715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.953035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.953352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.953665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.954016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.954339 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.954649 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.954966 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.955281 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.955594 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.955905 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.956346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.956667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.956986 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.957296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.957612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.957954 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.958283 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.958604 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.958916 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.959334 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.959758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.959965 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.960281 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.960610 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.960907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.961219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.961563 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.961862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.962199 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.962511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.962845 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.963686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.964605 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.965040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.965363 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.965650 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:51.965759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.966117 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.966440 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.966760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.967092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.967426 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.967759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.968071 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.968392 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.968709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.969040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.969371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.969689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.970036 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.970408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.970682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.971016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.971335 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.971662 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.972085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.972415 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.972731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.973061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.973392 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.973701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.974034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.974366 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.974664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.974972 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.975299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.975607 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.975924 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.976241 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.976552 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.976858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.977166 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.977498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.977806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.978156 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.978475 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.979905 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.980254 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.980575 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.980914 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.981240 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.981558 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.981872 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.982217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.982571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.982885 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.983213 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.983554 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.983889 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.984207 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.984550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.984888 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.985210 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.985536 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.985867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.986205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.986515 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.986833 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.987144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.987457 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.987772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.988087 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.988397 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.988709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.989020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.989350 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.989659 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.990013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.990329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.990642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.990953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.991262 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.991612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.991922 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.992261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.992588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.992918 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.993252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.993567 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.993899 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.994271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.995495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.995828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.996159 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.996490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.996818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.997142 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.997464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.997803 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.998139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.998467 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.999033 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.999370 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:51.999691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.000011 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.000330 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.000654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.000972 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.001292 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.001617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.001953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.002276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.002613 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.002954 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.003285 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.003721 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.004323 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.004993 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.005483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.006103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.006758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.007323 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.007934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.008348 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.008683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.009153 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.009608 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.010173 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.011094 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.011426 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.011757 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.012090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.012421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.012748 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.013086 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.013433 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.013764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.014111 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.014439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.014764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.015329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.015654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.015997 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.016333 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.016665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.016993 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.017318 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.017650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.018008 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.018299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.018616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.018932 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.019243 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.019570 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.019887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.020199 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.020526 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.020863 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.021383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.021738 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.022089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.022425 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.022758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.023083 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.023394 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.023724 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.024035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.024345 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.024676 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.024991 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.025303 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.026269 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.026706 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.027242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.027677 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.028000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.028322 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.028667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.034304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.036779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.036779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.036779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.036779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.036779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.036779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.037616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.037616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.037953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.038369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.038698 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.039042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.039374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.039718 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.040052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.040382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.040614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.context [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),334d5eb6-08fc-4490-ba4b-66711b77338f(cell1) {{(pid=122586) load_cells /opt/stack/nova/nova/context.py:464}} Dec 07 18:43:52.040785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.041067 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.042851 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.043255 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.043686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.043986 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.044307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.044631 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.044953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.045274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.045611 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.045760 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:43:52.045953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.046274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.046640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.046916 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.047238 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.047354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:43:52.047565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.047885 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.048074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:43:52.048205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.048527 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.048849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.049201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.049530 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.049858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.050014 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:43:52.050210 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.050537 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.050856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.051174 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.051492 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.051809 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.052135 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.052476 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.052801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.053118 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.053557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.054161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.054493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.054827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.055450 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.055793 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.056130 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.056455 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.056812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.057687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.058060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.058421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.058766 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.059102 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.059456 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.059975 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.060452 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.060621 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.060967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.061317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.061642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.062073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.062411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.062746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.063067 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.063314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:52.063427 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.063723 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.064052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.064326 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:52.064477 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.064701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.065170 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.065340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.067031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.067031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.067031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.067031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.067031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.067413 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.067583 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.069100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.069100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.069100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.069100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.069401 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.069748 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.070097 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.070428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.070747 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.071068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.071396 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.071722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.072064 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.072442 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.073451 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.073872 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.074279 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.074667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.075159 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.075581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.075912 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.076239 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.076555 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 07 18:43:52.076840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 07 18:43:52.100465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:52.169598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.context [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),334d5eb6-08fc-4490-ba4b-66711b77338f(cell1) {{(pid=122585) load_cells /opt/stack/nova/nova/context.py:464}} Dec 07 18:43:52.173791 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:43:52.175398 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:43:52.176228 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:43:52.178223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:43:52.191493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:52.192421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:52.225871 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_db.sqlalchemy.engines [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:52.364827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 07 18:43:52.564641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: WARNING keystonemiddleware.auth_token [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:43:52.575410 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: WARNING keystonemiddleware.auth_token [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:43:52.736654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: WARNING keystonemiddleware.auth_token [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:43:52.743926 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: WARNING keystonemiddleware.auth_token [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:43:52.927261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: WARNING keystonemiddleware.auth_token [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:43:52.933845 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: WARNING keystonemiddleware.auth_token [None req-86dc3f5b-e738-455b-b178-5556fdfe4476 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:43:52.940890 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5647ab0a79c0 pid: 122586 (default app) Dec 07 18:43:53.111651 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: WARNING keystonemiddleware.auth_token [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 07 18:43:53.116779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: WARNING keystonemiddleware.auth_token [None req-d8b82d85-fa0d-427b-8550-3653cd610652 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 07 18:43:53.122289 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647ab0a79c0 pid: 122585 (default app) Dec 07 18:44:29.780576 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1988996003", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "c8b8ce23-5289-4bad-a75a-485ea880ca99"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:30.036090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1535372902", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "ef05ef7a-dc68-401a-ab2a-8c16865c781c"}]}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:30.795179 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] validate_networks() for [('c8b8ce23-5289-4bad-a75a-485ea880ca99', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:44:30.839790 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] validate_networks() for [('ef05ef7a-dc68-401a-ab2a-8c16865c781c', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:44:32.764746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:44:32.765382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:44:32.766274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:44:32.766824 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:44:32.767348 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:44:32.797299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:32.798371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:32.799446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:32.802181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:32.855008 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Getting quotas for project 8cf66e1a2b384f8abac34fbb53354039. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:44:32.865072 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Getting quotas for user c477cff657ed43f0bbb2040c0514bf92 and project 8cf66e1a2b384f8abac34fbb53354039. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:44:32.880708 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:44:32.884418 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:44:33.020478 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-63937d20-72c1-4dcc-9186-04a164693e81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.601155 Dec 07 18:44:33.028899 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:44:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 4604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:44:33.036189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7cdbb295-8244-4147-be01-103987a2b187 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:33.037088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7cdbb295-8244-4147-be01-103987a2b187 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:33.151382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:44:33.152370 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:44:33.153452 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:44:33.153864 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:44:33.154493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:44:33.197389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:33.199136 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:33.200110 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:33.200723 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:33.259684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:44:33.275733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for user be5301c42eaa4538800ccab20dfc9b7c and project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:44:33.310151 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:44:33.318975 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:44:33.439526 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7cdbb295-8244-4147-be01-103987a2b187 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:33.479078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7cdbb295-8244-4147-be01-103987a2b187 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1215 microversion: 2.1 time: 0.448085 Dec 07 18:44:33.479665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 2/2] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:33 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1215 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:33.531477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-dbc5319e-ffd4-41ce-89e1-7b6e5b95e74c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.165910 Dec 07 18:44:33.532150 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:44:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 5168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:44:33.543450 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-949865b0-55ee-4485-99dd-4dc40808b41a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:33.544072 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-949865b0-55ee-4485-99dd-4dc40808b41a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:33.735906 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-949865b0-55ee-4485-99dd-4dc40808b41a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:33.746069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-949865b0-55ee-4485-99dd-4dc40808b41a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1218 microversion: 2.1 time: 0.206404 Dec 07 18:44:33.750850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 3/4] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:33 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:34.499018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-28a9af6e-f5f6-479e-a2c2-39f8ca42e97a tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:34.499959 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-28a9af6e-f5f6-479e-a2c2-39f8ca42e97a tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:34.768780 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-445106a0-e69a-4980-aab4-2a574ce07114 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:34.770747 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-445106a0-e69a-4980-aab4-2a574ce07114 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:34.971130 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-445106a0-e69a-4980-aab4-2a574ce07114 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:34.979738 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-445106a0-e69a-4980-aab4-2a574ce07114 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1218 microversion: 2.1 time: 0.216290 Dec 07 18:44:34.982484 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 4/5] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:34 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:35.233966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-28a9af6e-f5f6-479e-a2c2-39f8ca42e97a tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:35.272113 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-28a9af6e-f5f6-479e-a2c2-39f8ca42e97a tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1215 microversion: 2.1 time: 0.776216 Dec 07 18:44:35.282004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 2/6] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:34 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1215 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:36.012192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:36.018739 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:36.033554 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:36.035022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:36.037653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:36.038778 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:36.235688 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:36.259850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fcea0352-aedc-4a37-9a81-5627c9d240bc tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1214 microversion: 2.1 time: 0.264751 Dec 07 18:44:36.260890 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 5/7] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:35 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:44:36.299004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:36.299886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:36.309564 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:36.314570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:36.315517 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:36.320614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:36.896709 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:36.922532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-993d6a3a-7935-434d-a097-d0f85870dc28 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1275 microversion: 2.1 time: 0.628332 Dec 07 18:44:36.926319 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 3/8] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:36 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1275 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:37.283576 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:37.285538 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:37.296109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:37.298425 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:37.300944 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:37.302829 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:37.620132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:37.631245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0bffe3bd-2040-4d20-8146-3703f7a48407 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1278 microversion: 2.1 time: 0.356739 Dec 07 18:44:37.632358 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 6/9] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:37 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1278 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:37.943656 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:37.944401 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:37.957893 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:37.966033 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:37.967361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:37.971959 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:38.165627 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:38.177680 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c2acda79-5f1c-4af5-81ca-f0cde520dd6c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1273 microversion: 2.1 time: 0.236455 Dec 07 18:44:38.183037 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 4/10] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:37 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:38.650533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:38.652643 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:38.663984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:38.666488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:38.667632 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:38.668254 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:38.935384 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:38.952805 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7cd3e861-98be-4cd6-9ce8-56ec4084d05e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1276 microversion: 2.1 time: 0.307698 Dec 07 18:44:38.959767 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 7/11] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:38 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1276 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:39.204352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:39.208891 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:39.223859 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:39.231315 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:39.238280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:39.238747 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:39.559525 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:39.571577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1fce6649-fd4e-43eb-8ec6-4b68a383a613 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1273 microversion: 2.1 time: 0.375417 Dec 07 18:44:39.575379 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 5/12] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:39 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1273 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:39.977208 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:39.978326 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:39.991551 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:39.993465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:40.000308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:40.018692 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:40.592032 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:40.592644 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:40.608808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:40.609262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:40.610551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:40.613364 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:40.838954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:40.866242 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-88d51d2f-9734-4cbc-a411-a792dfc5ce43 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1273 microversion: 2.1 time: 0.274175 Dec 07 18:44:40.871171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 6/13] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:40 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:42.089029 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:42.101411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6cba2d1e-a9e9-464e-a7f7-b882bbd1dd78 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 2.128385 Dec 07 18:44:42.107982 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 8/14] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:39 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 2134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:42.130812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:42.134788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:42.157408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-52acb8e5-dd53-47ff-900f-7c6ab4370de2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'create', calling method: .version_select at 0x7f199a8c9af0>, body: {"keypair": {"name": "tempest-keypair-1643992554"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:42.183327 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:42.189897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:42.194295 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:42.197048 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:42.263262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-52acb8e5-dd53-47ff-900f-7c6ab4370de2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:44:42.280505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-52acb8e5-dd53-47ff-900f-7c6ab4370de2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for user 87d73e143d814bd6b6b09961603410b9 and project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:44:42.994385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-52acb8e5-dd53-47ff-900f-7c6ab4370de2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:44:43.003496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-52acb8e5-dd53-47ff-900f-7c6ab4370de2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for user 87d73e143d814bd6b6b09961603410b9 and project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:44:43.044389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-52acb8e5-dd53-47ff-900f-7c6ab4370de2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.551434 Dec 07 18:44:43.051609 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 7/15] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Dec 7 18:44:41 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:43.124981 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:43.126062 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:43.138808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:43.159541 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:43.163587 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:43.167299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:43.224053 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:43.247734 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8ca7fc62-4786-47e2-b5fa-794881c0db3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 1.134963 Dec 07 18:44:43.270673 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 9/16] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:42 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:44.266072 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:44.266701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:44.288857 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:44.289283 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:44.290993 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:44.291537 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:44.520849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:44.528965 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4ffd403e-846e-49dc-ba18-397d43830fd9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 1.412040 Dec 07 18:44:44.531886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 8/17] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:43 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:45.842296 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-2dc1a36b-e4b5-429f-81d4-2121a69334d5 req-c248c476-b00d-44c8-8e38-287a6476e7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "227d00ae-26f9-4f9d-8aa8-87aa48f24b6d", "tag": "3a78c11c-a38a-41c4-8b8d-2c6c97e8cf2a"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:45.845248 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:44:45.845248 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:44:45.888045 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-2dc1a36b-e4b5-429f-81d4-2121a69334d5 req-c248c476-b00d-44c8-8e38-287a6476e7c3 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:45.888581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-2dc1a36b-e4b5-429f-81d4-2121a69334d5 req-c248c476-b00d-44c8-8e38-287a6476e7c3 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:45.975430 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-2dc1a36b-e4b5-429f-81d4-2121a69334d5 req-c248c476-b00d-44c8-8e38-287a6476e7c3 service nova] Creating event network-changed:3a78c11c-a38a-41c4-8b8d-2c6c97e8cf2a for instance 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d on hv-cinder-81969 Dec 07 18:44:45.975983 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-2dc1a36b-e4b5-429f-81d4-2121a69334d5 req-c248c476-b00d-44c8-8e38-287a6476e7c3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 07 18:44:45.986556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e07e0ecb-0e23-4901-9e73-0064d0289e02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:45.989350 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e07e0ecb-0e23-4901-9e73-0064d0289e02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:45.991521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e07e0ecb-0e23-4901-9e73-0064d0289e02 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:45.991985 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e07e0ecb-0e23-4901-9e73-0064d0289e02 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:46.027161 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.compute.rpcapi [None req-e07e0ecb-0e23-4901-9e73-0064d0289e02 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 07 18:44:46.034586 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e07e0ecb-0e23-4901-9e73-0064d0289e02 None None] Releasing lock "compute-rpcapi-router" {{(pid=122586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 07 18:44:46.066824 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:46.077195 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-df10b003-9a5f-477f-954c-f0e0075007e2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 1.816273 Dec 07 18:44:46.090378 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e07e0ecb-0e23-4901-9e73-0064d0289e02 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602010 Dec 07 18:44:46.090977 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 9/18] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:44:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:44:46.091368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 10/19] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:44 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:44:46.101488 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:46.102570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:46.114016 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:46.120188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:46.122152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:46.125198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:46.653668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:46.680476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-addf8cbd-9252-4f64-a745-6532e657b63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.579680 Dec 07 18:44:46.683512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 10/20] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:46 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:47.109746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:47.111195 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:47.120090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:47.120775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:47.122380 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:47.127002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:47.763060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-7725119f-b06e-4952-96fe-a006de1b8786 req-204f45b1-4429-4a8a-a06e-fb5584c66696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8", "tag": "a7b6886d-664d-4ad4-b0e0-be7fe72c4fdb"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:47.767193 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:44:47.767193 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:44:47.793848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-7725119f-b06e-4952-96fe-a006de1b8786 req-204f45b1-4429-4a8a-a06e-fb5584c66696 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:47.795776 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-7725119f-b06e-4952-96fe-a006de1b8786 req-204f45b1-4429-4a8a-a06e-fb5584c66696 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:47.876500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-7725119f-b06e-4952-96fe-a006de1b8786 req-204f45b1-4429-4a8a-a06e-fb5584c66696 service nova] Creating event network-changed:a7b6886d-664d-4ad4-b0e0-be7fe72c4fdb for instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 on hv-cinder-81969 Dec 07 18:44:47.900618 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-7725119f-b06e-4952-96fe-a006de1b8786 req-204f45b1-4429-4a8a-a06e-fb5584c66696 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336671 Dec 07 18:44:47.902063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 11/21] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:44:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:44:47.952656 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:47.956134 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:47.988808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:47.989297 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:47.993383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:47.996912 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:48.063151 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:48.071028 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-201cfbfa-779b-4920-af14-e39980a13d81 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.966415 Dec 07 18:44:48.074974 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 11/22] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:47 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:49.169640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1879780885", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21f5f496-97bc-411b-8951-cfa100658247"}]}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:49.288478 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] validate_networks() for [('21f5f496-97bc-411b-8951-cfa100658247', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:44:49.332557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:49.341221 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ca94daa9-0e40-4253-96f7-bd99bef72162 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 1.426396 Dec 07 18:44:49.357949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 12/23] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:47 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:49.377426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:49.384686 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:49.403460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:49.407637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:49.412726 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:49.413495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:50.166121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:50.181262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e0d982f1-1804-4e27-afce-c4cfbccb55b7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.816275 Dec 07 18:44:50.183339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 13/24] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:49 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:50.368121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:50.369232 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:50.379091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:50.389068 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:50.390158 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:50.391340 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:50.496374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:44:50.498534 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:44:50.499206 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:44:50.500708 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:44:50.501293 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:44:50.538205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:50.538623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:50.541583 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:50.543943 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:50.585689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Getting quotas for project b1c0284a24444edf87293c9fe818e638. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:44:50.594638 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Getting quotas for user f90a40a0ea3f4365b5813347c6027244 and project b1c0284a24444edf87293c9fe818e638. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:44:50.621251 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:44:50.626562 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:44:50.728042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fa967e73-66f6-44ad-afb4-398e5beb9b23 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.153437 Dec 07 18:44:50.737004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 12/25] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:44:48 2021] POST /compute/v2.1/servers => generated 383 bytes in 2164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:44:50.746821 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1870427637", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a321d8bd-fce1-4a8d-9656-239d82555545"}], "security_groups": [{"name": "tempest-securitygroup--148761583"}], "key_name": "tempest-keypair-1643992554", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:50.754759 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:50.763496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d2e87c53-5ea2-42b2-9d0d-ee575c240fc3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.404528 Dec 07 18:44:50.770318 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 14/26] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:50 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:50.777321 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-fa337202-b43d-4e81-9fd3-3cb7ad776a75 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:50.781945 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-fa337202-b43d-4e81-9fd3-3cb7ad776a75 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:50.885124 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-fa337202-b43d-4e81-9fd3-3cb7ad776a75 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:50.895925 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-fa337202-b43d-4e81-9fd3-3cb7ad776a75 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1222 microversion: 2.1 time: 0.124226 Dec 07 18:44:50.904965 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 15/27] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:50 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:51.072289 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] validate_networks() for [('a321d8bd-fce1-4a8d-9656-239d82555545', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:44:51.120855 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1680944915", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21f5f496-97bc-411b-8951-cfa100658247"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:44:51.251998 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] validate_networks() for [('21f5f496-97bc-411b-8951-cfa100658247', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:44:52.179852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:44:52.181728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:44:52.182498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:44:52.183255 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:44:52.185251 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:44:52.199341 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:44:52.199896 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:44:52.204528 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:44:52.205152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:44:52.205588 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:44:52.211120 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.212408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:52.217377 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.221856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:52.222425 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.222818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:52.223634 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.229513 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:52.275623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for project cbb0144e924847109e6a254192f1e6bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:44:52.281373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Getting quotas for project b1c0284a24444edf87293c9fe818e638. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:44:52.286000 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Getting quotas for user f90a40a0ea3f4365b5813347c6027244 and project b1c0284a24444edf87293c9fe818e638. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:44:52.288722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for user 87d73e143d814bd6b6b09961603410b9 and project cbb0144e924847109e6a254192f1e6bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:44:52.299533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:44:52.302150 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:44:52.323678 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:44:52.326874 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:44:52.366465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-21b096b2-33bd-44ac-b477-f50c3cd40c59 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.251676 Dec 07 18:44:52.368497 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 16/28] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:44:51 2021] POST /compute/v2.1/servers => generated 383 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:44:52.389883 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:52.392003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:52.410124 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.426476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:52.429807 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.433590 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:52.452478 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6c69dc07-2637-41db-b09a-de611dfe78bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.714301 Dec 07 18:44:52.453248 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 13/29] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:44:50 2021] POST /compute/v2.1/servers => generated 401 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:44:52.488950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:52.489861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:52.511506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.514214 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:52.527757 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:52.528568 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:53.364103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:53.379028 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3a426ab3-2952-4a92-8442-7f9ddcb01b4b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.923623 Dec 07 18:44:53.380492 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 14/30] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:52 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:53.394952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:53.407538 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1a015202-cdf3-4d4d-aa19-055898810bb4 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 1.035537 Dec 07 18:44:53.417143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 17/31] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:52 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:53.419313 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-66364049-0cdb-4e5e-8bc0-2270a7f161d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:53.421398 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-66364049-0cdb-4e5e-8bc0-2270a7f161d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:53.450010 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-905271b9-85f9-4ac1-bb5a-142c7c03afc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:53.450665 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-905271b9-85f9-4ac1-bb5a-142c7c03afc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:53.655529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-66364049-0cdb-4e5e-8bc0-2270a7f161d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:53.667488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-66364049-0cdb-4e5e-8bc0-2270a7f161d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1222 microversion: 2.1 time: 0.285236 Dec 07 18:44:53.672133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 15/32] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:53 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1222 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:53.857049 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-905271b9-85f9-4ac1-bb5a-142c7c03afc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:53.887035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-905271b9-85f9-4ac1-bb5a-142c7c03afc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1238 microversion: 2.1 time: 0.468787 Dec 07 18:44:53.888925 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 18/33] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:53 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1238 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:54.400629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:54.409731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:54.424477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:54.425702 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:54.431898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:54.435198 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:54.437287 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:54.437971 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:54.441102 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:54.441566 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:54.442398 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:54.442838 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:54.811869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:54.830504 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4017d9cf-a191-42f3-ace8-a1141dd50595 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.435264 Dec 07 18:44:54.849759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 16/34] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:54 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:54.865002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:54.865624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:54.886424 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:54.887179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:54.888288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:54.888994 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:54.974162 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:54.986006 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8edc7027-1168-492f-83cb-f1a5f17ab547 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1280 microversion: 2.1 time: 0.134856 Dec 07 18:44:54.987726 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 17/35] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:54 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1280 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:54.994931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:54.995789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:55.003441 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:55.004232 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:55.005219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:55.006050 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:55.104328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:55.115682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c7248bbb-e846-4ce8-8495-8bf9521431f6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1298 microversion: 2.1 time: 0.125578 Dec 07 18:44:55.118571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 18/36] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:54 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:55.243570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:55.252540 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ca062d4c-fad6-416b-ba2f-f1f08e14be29 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.830787 Dec 07 18:44:55.263629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 19/37] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:54 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:44:55.862904 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:55.863432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:55.871964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:55.872402 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:55.873276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:55.873586 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:56.004669 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:56.007145 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:56.016653 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:56.017340 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:56.018416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:56.019769 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:56.104046 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:56.116439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1187b0ac-1ab5-423d-8b1d-37a5d08d31a6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.256630 Dec 07 18:44:56.118118 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 19/38] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:55 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:56.119567 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:56.129139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0e89f7cf-ef2e-4e62-bfec-896e4fcd93fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1280 microversion: 2.1 time: 0.128284 Dec 07 18:44:56.129733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 20/39] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:55 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:44:56.143183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:56.144159 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:56.151010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:56.151482 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:56.152252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:56.152919 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:56.242292 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:56.251015 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-833a11e3-d457-4bf9-a98e-c54eae74c3b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1298 microversion: 2.1 time: 0.118052 Dec 07 18:44:56.251950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 20/40] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:56 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1298 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:56.270900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:56.271554 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:56.278466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:56.278922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:56.279742 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:56.280176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:56.485311 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:56.493943 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4f33a675-663c-4e10-964b-027ece1ad716 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.226718 Dec 07 18:44:56.494533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 21/41] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:56 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:57.133410 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:57.134271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:57.155942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:57.156715 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:57.163866 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.165489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.166485 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.166801 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.167376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.167573 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.168768 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.169217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.245679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:57.255973 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ec433bd5-1282-40e8-acde-ea4c85eba48d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1280 microversion: 2.1 time: 0.112468 Dec 07 18:44:57.257593 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 22/42] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:57 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1280 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:57.272624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:57.274250 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:57.284588 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.285372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.286900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.287755 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.332287 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:57.340940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e889976b-aa05-41ef-baca-7c8f45cc0968 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.211611 Dec 07 18:44:57.341842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 21/43] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:57 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:57.374071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:57.381862 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8bfa06ac-0553-4376-8cf9-b581674bf550 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1298 microversion: 2.1 time: 0.113970 Dec 07 18:44:57.382448 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 23/44] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:57 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1298 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:44:57.510456 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:57.511168 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:57.517560 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.518277 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.519540 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:57.520190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:57.664064 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:57.673112 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-34f7203d-010a-4e18-99fd-908262fdddc2 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.167106 Dec 07 18:44:57.673809 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 22/45] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:57 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:58.276953 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:58.278619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:58.300220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.300220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:58.300220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.300220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:58.357504 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:58.358327 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:58.369989 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.370439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:58.386561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.387930 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:58.580556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:58.597263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-27225583-7f2d-4804-bef0-d1d6dea0bb4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1280 microversion: 2.1 time: 0.325165 Dec 07 18:44:58.598336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 24/46] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:58 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:58.606605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:58.607505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:58.620014 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.620464 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:58.627285 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.630248 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:58.826197 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:58.827830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:58.836733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4c1327ba-a5fe-4901-bff7-9dc8d67d89bd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.482187 Dec 07 18:44:58.839034 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2368c9c5-474c-4234-bf8d-5665071891bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1296 microversion: 2.1 time: 0.235843 Dec 07 18:44:58.839830 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 23/48] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:58 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:44:58.839979 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 25/48] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:58 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1296 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:58.877228 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:58.881752 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:58.895394 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.896103 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:58.900626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:58.902457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:59.428629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:44:59.441386 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-62bfdc76-1b26-4de1-b96c-17b086516ee5 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.600013 Dec 07 18:44:59.444449 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 26/49] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:58 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:44:59.619912 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:59.621410 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:59.632629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:59.633277 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:59.634830 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:59.635319 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:59.861293 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:44:59.862200 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:44:59.893096 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:59.894455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:44:59.896487 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:44:59.897640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.190501 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:00.199696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-aa96aa9d-03a3-419d-875c-21148e295bd9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1280 microversion: 2.1 time: 0.587693 Dec 07 18:45:00.204372 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 24/50] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:59 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1280 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:00.222019 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:00.226381 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:00.241067 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:00.241530 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.242929 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:00.244878 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.656287 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:00.663756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4d4c13a2-f5c4-46f4-8b0e-2784ef47e63e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.457919 Dec 07 18:45:00.664796 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 25/51] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:00 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:00.678172 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-f3d7bffc-c1d8-468e-9d09-8f18607e9aa0 req-71d195da-decb-4bd9-ac7e-ca7833daee68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5651cc9-ef23-4b3a-bfc6-dd832eaec69f", "tag": "0668d3b9-3bd1-4d53-b1dc-5a28aa27efa9"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:00.681842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:00.681842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:00.702016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-f3d7bffc-c1d8-468e-9d09-8f18607e9aa0 req-71d195da-decb-4bd9-ac7e-ca7833daee68 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:00.706581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-f3d7bffc-c1d8-468e-9d09-8f18607e9aa0 req-71d195da-decb-4bd9-ac7e-ca7833daee68 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.733321 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:00.740672 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-53a18344-a366-4e83-886c-e92153d19866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.886984 Dec 07 18:45:00.741269 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 27/52] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:44:59 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:00.762581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:00.765283 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-f3d7bffc-c1d8-468e-9d09-8f18607e9aa0 req-71d195da-decb-4bd9-ac7e-ca7833daee68 service nova] Creating event network-changed:0668d3b9-3bd1-4d53-b1dc-5a28aa27efa9 for instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f on hv-cinder-81969 Dec 07 18:45:00.766222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:00.775307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-f3d7bffc-c1d8-468e-9d09-8f18607e9aa0 req-71d195da-decb-4bd9-ac7e-ca7833daee68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 07 18:45:00.776712 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ded178fc-ffc0-41d2-991d-ba4579cb33f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:00.777316 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ded178fc-ffc0-41d2-991d-ba4579cb33f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.778325 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ded178fc-ffc0-41d2-991d-ba4579cb33f1 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:00.781420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:00.782126 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ded178fc-ffc0-41d2-991d-ba4579cb33f1 None None] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.782770 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.795854 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:00.798659 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:00.815329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.compute.rpcapi [None req-ded178fc-ffc0-41d2-991d-ba4579cb33f1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 07 18:45:00.816246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ded178fc-ffc0-41d2-991d-ba4579cb33f1 None None] Releasing lock "compute-rpcapi-router" {{(pid=122585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 07 18:45:00.874353 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ded178fc-ffc0-41d2-991d-ba4579cb33f1 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199854 Dec 07 18:45:00.874970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 26/53] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:01.191181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-5d431835-6fed-4ad8-9fba-d35718e75cdf req-2a1e1d4b-5ee9-4f15-8a28-7d42ab8c0335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8", "name": "network-vif-plugged", "status": "completed", "tag": "a7b6886d-664d-4ad4-b0e0-be7fe72c4fdb"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:01.192728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:01.192728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:01.213397 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-5d431835-6fed-4ad8-9fba-d35718e75cdf req-2a1e1d4b-5ee9-4f15-8a28-7d42ab8c0335 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.213798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-5d431835-6fed-4ad8-9fba-d35718e75cdf req-2a1e1d4b-5ee9-4f15-8a28-7d42ab8c0335 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.240729 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-5d431835-6fed-4ad8-9fba-d35718e75cdf req-2a1e1d4b-5ee9-4f15-8a28-7d42ab8c0335 service nova] Creating event network-vif-plugged:a7b6886d-664d-4ad4-b0e0-be7fe72c4fdb for instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 on hv-cinder-81969 Dec 07 18:45:01.256507 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-5d431835-6fed-4ad8-9fba-d35718e75cdf req-2a1e1d4b-5ee9-4f15-8a28-7d42ab8c0335 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298943 Dec 07 18:45:01.260216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 27/54] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:01.273078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-6c65cdf0-3589-4a47-b73e-95e4bd70c0d3 req-4f149f86-e955-4542-adfd-3bf9ef7cbcc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668cc429-6322-4b0b-8f3a-6d910c891444", "tag": "74f0e008-eb9a-47c1-abf0-a78d47978293"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:01.279682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:01.279682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:01.309735 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-6c65cdf0-3589-4a47-b73e-95e4bd70c0d3 req-4f149f86-e955-4542-adfd-3bf9ef7cbcc4 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.309735 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-6c65cdf0-3589-4a47-b73e-95e4bd70c0d3 req-4f149f86-e955-4542-adfd-3bf9ef7cbcc4 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.338823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-6c65cdf0-3589-4a47-b73e-95e4bd70c0d3 req-4f149f86-e955-4542-adfd-3bf9ef7cbcc4 service nova] Creating event network-changed:74f0e008-eb9a-47c1-abf0-a78d47978293 for instance 668cc429-6322-4b0b-8f3a-6d910c891444 on hv-cinder-81969 Dec 07 18:45:01.351818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-6c65cdf0-3589-4a47-b73e-95e4bd70c0d3 req-4f149f86-e955-4542-adfd-3bf9ef7cbcc4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088509 Dec 07 18:45:01.352915 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 28/55] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:01.358848 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:01.359668 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:01.365975 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.366430 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.367887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.368336 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.566187 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:01.575236 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e6e48ba5-6288-48a6-b7c4-61827cd12a3b tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.832943 Dec 07 18:45:01.576241 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 28/56] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:00 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:01.579027 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:01.597189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f0bd1a2b-a118-4cf4-81a2-b2abeee08c07 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.242707 Dec 07 18:45:01.603232 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 29/57] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:01 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:01.684627 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:01.685816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:01.693155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.693933 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.694958 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.696168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.759103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:01.760432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:01.782150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.782150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.782150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:01.782150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:01.920534 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:01.928477 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-374cc5c0-6cd3-46c8-bb0d-1a4d2d4483c2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.174009 Dec 07 18:45:01.929262 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 30/58] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:01 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:02.095317 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:02.104358 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-45afedda-a049-497b-b5b9-34015e865799 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.424562 Dec 07 18:45:02.114744 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 29/59] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:01 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:02.594695 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:02.595589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:02.606112 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:02.606112 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:02.606112 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:02.606394 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:02.620620 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:02.621068 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:02.641569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:02.642010 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:02.642803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:02.648292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:02.834743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:02.842589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-134fccaf-af23-4805-8917-78b997627e3c tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.252586 Dec 07 18:45:02.843158 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 31/60] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:02 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:02.878730 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:02.888029 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1a927598-67ff-4665-8c04-030e1899cdd4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.272697 Dec 07 18:45:02.889279 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 30/61] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:02 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:02.894373 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-601a933f-ac16-44c9-8bd9-f341332c2e11 req-296e06a5-f49e-4f44-bcab-28aba19ae53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9b1241-e140-4789-9341-cb20006c6eba", "tag": "f19111d7-a12d-47fe-8e06-28405cf67baa"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:02.895928 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:02.895928 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:02.903954 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-601a933f-ac16-44c9-8bd9-f341332c2e11 req-296e06a5-f49e-4f44-bcab-28aba19ae53d service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:02.904756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-601a933f-ac16-44c9-8bd9-f341332c2e11 req-296e06a5-f49e-4f44-bcab-28aba19ae53d service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:02.916968 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-601a933f-ac16-44c9-8bd9-f341332c2e11 req-296e06a5-f49e-4f44-bcab-28aba19ae53d service nova] Creating event network-changed:f19111d7-a12d-47fe-8e06-28405cf67baa for instance fb9b1241-e140-4789-9341-cb20006c6eba on hv-cinder-81969 Dec 07 18:45:02.922231 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-601a933f-ac16-44c9-8bd9-f341332c2e11 req-296e06a5-f49e-4f44-bcab-28aba19ae53d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031307 Dec 07 18:45:02.923106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 32/62] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:02.951201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:02.952597 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:02.960512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:02.961765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:02.962775 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:02.963214 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:03.110066 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:03.121615 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:03.122902 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:03.128356 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3e0829e5-ea2d-4780-9260-6c71bec931e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.185618 Dec 07 18:45:03.128954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 31/63] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:02 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:03.133325 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:03.134487 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:03.135849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:03.136382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:03.276748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-89188811-c255-4ffb-bc57-7bac6596399f req-0db8fe0a-5780-4ab1-8d39-8b8a81b1011f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227d00ae-26f9-4f9d-8aa8-87aa48f24b6d", "name": "network-vif-plugged", "status": "completed", "tag": "3a78c11c-a38a-41c4-8b8d-2c6c97e8cf2a"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:03.278972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:03.278972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:45:03.289086 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:03.289851 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-89188811-c255-4ffb-bc57-7bac6596399f req-0db8fe0a-5780-4ab1-8d39-8b8a81b1011f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:03.290338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-89188811-c255-4ffb-bc57-7bac6596399f req-0db8fe0a-5780-4ab1-8d39-8b8a81b1011f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:03.297805 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7e0c7299-9617-4170-bca3-e004bb3c0b7e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.180916 Dec 07 18:45:03.308811 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-89188811-c255-4ffb-bc57-7bac6596399f req-0db8fe0a-5780-4ab1-8d39-8b8a81b1011f service nova] Creating event network-vif-plugged:3a78c11c-a38a-41c4-8b8d-2c6c97e8cf2a for instance 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d on hv-cinder-81969 Dec 07 18:45:03.310595 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 33/64] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:03 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:03.312957 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-89188811-c255-4ffb-bc57-7bac6596399f req-0db8fe0a-5780-4ab1-8d39-8b8a81b1011f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041586 Dec 07 18:45:03.313553 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 32/65] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:45:03.861075 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:03.861777 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:03.875334 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:03.877316 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:03.878235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:03.879493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:03.907681 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:03.908457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:03.920137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:03.923526 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:03.925336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:03.928496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:04.372282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:04.380090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-31e8319c-a794-4e92-a918-cf23b922a240 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.523524 Dec 07 18:45:04.391007 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 34/66] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:03 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:04.396129 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:04.396962 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:04.408731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:04.409602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:04.410679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:04.412520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:04.507421 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:04.520815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ab29bf78-b090-49fa-a1bd-f953022878b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.615964 Dec 07 18:45:04.522069 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 33/67] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:03 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:04.538583 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:04.540756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:04.559324 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:04.562505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:04.566098 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:04.566637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:04.837178 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:04.846202 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9ce52b7e-f98b-4e42-8cc5-f6aee39f923c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.453774 Dec 07 18:45:04.852059 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 35/68] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:04 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:05.264831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:05.273275 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ad0dfee0-9e7a-43b8-b40d-9732111a684b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.746583 Dec 07 18:45:05.275092 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 34/69] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:04 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:05.408075 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:05.409385 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:05.421088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:05.421885 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:05.422897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:05.423860 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:05.539225 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:05.540539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:05.546527 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:05.547051 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:05.547908 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:05.548521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:05.680956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:05.688681 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-67959ca5-3a3b-4451-b45e-b8bd53e40e17 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.284915 Dec 07 18:45:05.689634 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 36/70] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:05 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:05.868706 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:05.869303 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:05.879356 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:05.884264 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:05.885356 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:05.886000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:05.925609 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:05.934086 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-eecf0f78-b1f9-4a79-b91f-962a0f8bd4d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.398717 Dec 07 18:45:05.934669 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 35/71] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:05 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:06.096367 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:06.110664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fd2328d7-0676-4209-8286-4b5ab2b66f9c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.243219 Dec 07 18:45:06.125397 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 37/72] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:05 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:06.291909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:06.292521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:06.300194 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:06.303193 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:06.306699 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:06.307262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:06.597159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:06.610502 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-84d94e54-81f6-4299-8c68-16e924df39d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.323063 Dec 07 18:45:06.611162 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 36/73] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:06 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:06.708248 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:06.708953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:06.725562 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:06.731818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:06.732662 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:06.733107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:06.941658 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:06.950723 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:06.951470 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:06.961899 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:06.962624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7d1ad463-ccde-4db5-bca5-2034246cdf07 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.255543 Dec 07 18:45:06.963733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 38/74] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:06 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:06.964155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:06.964995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:06.965437 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:07.145059 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:07.146802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:07.151030 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:07.165402 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:07.166734 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-894629b9-664c-43a5-b5ee-a75506a83fe7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.217208 Dec 07 18:45:07.167144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:07.168644 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:07.169152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 37/75] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:06 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:07.169743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:07.359652 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:07.368966 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-458da835-d21e-40da-b6e8-47b7b2ecdd88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.227386 Dec 07 18:45:07.386874 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 39/76] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:07 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:07.627433 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:07.628031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:07.634277 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:07.634729 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:07.635514 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:07.635951 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:07.788933 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:07.798426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-52e3c765-877b-4c6b-907b-168d23de76aa tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.174554 Dec 07 18:45:07.801840 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 38/77] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:07 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:07.980923 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:07.981535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:07.987334 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:07.987777 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:07.988571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:07.988999 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:08.165803 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:08.173706 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4d604d91-a011-48f4-90e4-6e21ed8cacc3 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.197820 Dec 07 18:45:08.174315 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 40/78] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:07 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:08.187267 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:08.187869 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:08.193753 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:08.194275 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:08.195108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:08.195620 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:08.354941 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:08.362898 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-52bcd93d-6e40-4941-9bf9-8efa17dcd558 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.179957 Dec 07 18:45:08.363698 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 39/79] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:08 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:08.398165 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:08.399367 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:08.406602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:08.407054 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:08.408947 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:08.409695 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:08.583651 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:08.590792 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bb75cef6-db53-42c0-b897-176a23616af1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.199949 Dec 07 18:45:08.591386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 41/80] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:08 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:08.817519 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:08.818175 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:08.824856 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:08.825314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:08.826183 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:08.826625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:08.975324 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:08.986036 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2034a97d-9d25-41d2-8894-9af4342b890a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1318 microversion: 2.1 time: 0.171602 Dec 07 18:45:08.986609 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 40/81] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:08 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:09.192948 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:09.193679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:09.199922 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:09.200539 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:09.201369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:09.201854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:09.389986 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:09.397353 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3186b933-a45f-4660-8273-b4b0db827446 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1315 microversion: 2.1 time: 0.208674 Dec 07 18:45:09.407722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 42/82] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:09 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:09.436677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:09.437282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:09.443048 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:09.443499 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:09.444270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:09.447890 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:09.591233 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:09.598826 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-93999d58-5e34-42da-b89c-81c334c4826c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.165883 Dec 07 18:45:09.599503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 41/83] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:09 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:09.608440 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:09.609188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:09.616572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:09.617349 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:09.618332 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:09.618926 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:09.790051 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:09.797141 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-365f5077-1bf6-4c77-8ddb-cb657e25e562 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.192613 Dec 07 18:45:09.797703 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 43/84] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:09 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:10.005150 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:10.005785 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:10.029136 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.029614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.030614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.031292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.266135 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:10.275483 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-62342a91-d96f-43bc-831e-cc2fe0250f8d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1509 microversion: 2.1 time: 0.274487 Dec 07 18:45:10.276180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 42/85] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:09 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:10.420481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:10.421109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:10.428217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.428906 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.430234 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.430916 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.621727 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:10.622454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:10.637535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.639107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:10.639799 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.640995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.642030 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.647306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-013f2943-1807-4ec2-a16d-1ed25ab70042 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1503 microversion: 2.1 time: 0.234042 Dec 07 18:45:10.656786 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 44/86] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:10 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:10.815459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:10.816469 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:10.832167 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.832841 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.847541 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:10.848009 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:10.903965 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:10.920343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-71b8e576-a5ca-4d94-aeb8-cc0e769fd598 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.302697 Dec 07 18:45:10.923282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 43/87] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:10 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:11.065634 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:11.077653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f2d26c92-d0c8-4a27-8ace-bc460dfd25b5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.266286 Dec 07 18:45:11.078414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 45/88] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:10 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:11.549292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2fd76168-4e92-4bee-b6b4-d2b72de1ea79 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dba477f8-2295-4fd1-a895-7ad2cc3e8c24"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:11.550599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2fd76168-4e92-4bee-b6b4-d2b72de1ea79 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:11.558389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fd76168-4e92-4bee-b6b4-d2b72de1ea79 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:11.559065 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fd76168-4e92-4bee-b6b4-d2b72de1ea79 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:11.560053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fd76168-4e92-4bee-b6b4-d2b72de1ea79 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:11.560480 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fd76168-4e92-4bee-b6b4-d2b72de1ea79 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:11.906522 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-b3001eb6-4727-49d8-b58e-8a2c7aa24693 req-96ba33c7-2567-4193-ad55-4b898d95b3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5651cc9-ef23-4b3a-bfc6-dd832eaec69f", "name": "network-vif-plugged", "status": "completed", "tag": "0668d3b9-3bd1-4d53-b1dc-5a28aa27efa9"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:11.908593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:11.908593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:11.917836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b3001eb6-4727-49d8-b58e-8a2c7aa24693 req-96ba33c7-2567-4193-ad55-4b898d95b3f6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:11.918862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b3001eb6-4727-49d8-b58e-8a2c7aa24693 req-96ba33c7-2567-4193-ad55-4b898d95b3f6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:11.934981 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-b3001eb6-4727-49d8-b58e-8a2c7aa24693 req-96ba33c7-2567-4193-ad55-4b898d95b3f6 service nova] Creating event network-vif-plugged:0668d3b9-3bd1-4d53-b1dc-5a28aa27efa9 for instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f on hv-cinder-81969 Dec 07 18:45:11.942386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-b3001eb6-4727-49d8-b58e-8a2c7aa24693 req-96ba33c7-2567-4193-ad55-4b898d95b3f6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040179 Dec 07 18:45:11.944716 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 46/89] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:11.950944 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:11.952640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:11.969840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:11.970462 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:11.973746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:11.974442 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:12.044964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2fd76168-4e92-4bee-b6b4-d2b72de1ea79 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500027 Dec 07 18:45:12.046539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 44/90] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:45:11 2021] POST /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:12.098432 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:12.099180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:12.120915 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:12.123184 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:12.124288 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:12.128034 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:12.254224 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:12.262686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-89a83934-c02c-40c0-b9ac-e9d212751e77 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.315869 Dec 07 18:45:12.264129 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 47/91] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:11 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:12.268925 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f20882e5-be41-48fc-b9a4-89cc69890176 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f10ad427-0968-4144-8049-bf8a01fb0f04"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:12.270030 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f20882e5-be41-48fc-b9a4-89cc69890176 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:12.276858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f20882e5-be41-48fc-b9a4-89cc69890176 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:12.277386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f20882e5-be41-48fc-b9a4-89cc69890176 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:12.278104 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f20882e5-be41-48fc-b9a4-89cc69890176 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:12.278539 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f20882e5-be41-48fc-b9a4-89cc69890176 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:12.539812 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:12.551843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2732c14f-640e-4577-bdcd-4e66818beb63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.457618 Dec 07 18:45:12.552386 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 45/92] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:12 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:13.129624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f20882e5-be41-48fc-b9a4-89cc69890176 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "POST /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863791 Dec 07 18:45:13.132100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 48/93] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:45:12 2021] POST /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:13.280045 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:13.280662 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:13.286603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:13.287061 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:13.287842 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:13.288420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:13.505171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:13.516312 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-752d52e0-398c-4850-89d6-c2697e76b78f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.239837 Dec 07 18:45:13.516876 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 46/94] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:13 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:13.569939 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:13.571208 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:13.578411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:13.578866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:13.579643 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:13.580077 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:13.751026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:13.761813 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bbbadd84-eef0-4d03-843a-2947118a3ff0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.196539 Dec 07 18:45:13.773900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 49/95] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:13 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:14.533548 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:14.534198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:14.540478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:14.540924 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:14.541690 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:14.542157 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:14.682456 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:14.689932 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-32e6a102-5190-4be4-9a07-43ab366814ca tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.159982 Dec 07 18:45:14.690507 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 47/96] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:14 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:14.787346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:14.787959 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:14.794750 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:14.795388 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:14.796243 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:14.796728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:14.940218 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:14.947829 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c8db58fb-9f93-4a31-84a1-1b7f1e825513 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.164493 Dec 07 18:45:14.948391 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 50/97] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:14 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:15.709501 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:15.711300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:15.718326 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:15.719226 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:15.720204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:15.720707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:15.768770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-0b935418-97bf-42a9-b71e-eb7284e6f3f0 req-7a30a700-2473-4357-bf2b-09b3c603bc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668cc429-6322-4b0b-8f3a-6d910c891444", "name": "network-vif-plugged", "status": "completed", "tag": "74f0e008-eb9a-47c1-abf0-a78d47978293"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:15.771426 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:15.771426 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:15.783241 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-0b935418-97bf-42a9-b71e-eb7284e6f3f0 req-7a30a700-2473-4357-bf2b-09b3c603bc58 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:15.783752 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-0b935418-97bf-42a9-b71e-eb7284e6f3f0 req-7a30a700-2473-4357-bf2b-09b3c603bc58 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:15.798806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-0b935418-97bf-42a9-b71e-eb7284e6f3f0 req-7a30a700-2473-4357-bf2b-09b3c603bc58 service nova] Creating event network-vif-plugged:74f0e008-eb9a-47c1-abf0-a78d47978293 for instance 668cc429-6322-4b0b-8f3a-6d910c891444 on hv-cinder-81969 Dec 07 18:45:15.804797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-0b935418-97bf-42a9-b71e-eb7284e6f3f0 req-7a30a700-2473-4357-bf2b-09b3c603bc58 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040111 Dec 07 18:45:15.806246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 51/98] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:45:15.965414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:15.966158 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:15.975338 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:15.977747 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:15.979273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:15.986634 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:15.998050 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-472eb89c-e43e-4da8-b5de-a87b3b2b7c5d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.293949 Dec 07 18:45:16.002368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:16.016802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 48/99] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:15 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:16.159913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:16.171882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-015cdcc6-1267-4f3a-8107-b314c07102e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.210469 Dec 07 18:45:16.172911 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 52/100] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:15 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:17.022913 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:17.023542 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:17.030394 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:17.030846 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:17.031625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:17.032056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:17.182652 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:17.189801 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-843defd0-b6fd-4e4a-8234-e372fee29658 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.170518 Dec 07 18:45:17.190395 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 49/101] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:17 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:17.190957 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:17.191921 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:17.198755 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:17.199203 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:17.199973 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:17.200406 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:17.335212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:17.342588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8ce733d3-9dbe-472e-b170-99967f37e3f4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.155287 Dec 07 18:45:17.343150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 53/102] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:17 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:17.852824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-1f8107a0-a871-4463-b024-c5c9fe4effff req-e235d89e-d3b6-4258-9722-31fbcc71f05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9b1241-e140-4789-9341-cb20006c6eba", "name": "network-vif-plugged", "status": "completed", "tag": "f19111d7-a12d-47fe-8e06-28405cf67baa"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:17.854608 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:17.854608 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:45:17.861354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-1f8107a0-a871-4463-b024-c5c9fe4effff req-e235d89e-d3b6-4258-9722-31fbcc71f05b service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:17.861866 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-1f8107a0-a871-4463-b024-c5c9fe4effff req-e235d89e-d3b6-4258-9722-31fbcc71f05b service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:17.872089 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-1f8107a0-a871-4463-b024-c5c9fe4effff req-e235d89e-d3b6-4258-9722-31fbcc71f05b service nova] Creating event network-vif-plugged:f19111d7-a12d-47fe-8e06-28405cf67baa for instance fb9b1241-e140-4789-9341-cb20006c6eba on hv-cinder-81969 Dec 07 18:45:17.877010 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-1f8107a0-a871-4463-b024-c5c9fe4effff req-e235d89e-d3b6-4258-9722-31fbcc71f05b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027697 Dec 07 18:45:17.877585 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 50/103] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:18.206462 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:18.207060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:18.214024 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:18.214469 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:18.215238 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:18.215668 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:18.361595 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:18.362459 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:18.369352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:18.369953 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:18.371003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:18.371567 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:18.394907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:18.403528 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-82f04469-7d24-4e7c-9236-33e6cfd8b623 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.200426 Dec 07 18:45:18.406049 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 54/104] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:18 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:18.556070 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:18.563589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-57edb1a3-d625-4b86-83ca-f25b89b8f6d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.206695 Dec 07 18:45:18.564163 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 51/105] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:18 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:19.424368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:19.425010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:19.433324 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:19.434318 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:19.435290 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:19.435887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:19.581735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:19.582493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:19.592007 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:19.596526 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:19.600952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b6b07b32-41ee-49a1-879e-1218aa30cf83 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.184533 Dec 07 18:45:19.601856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 55/106] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:19 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:19.602750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:19.603574 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:19.604019 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:19.771400 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:19.780730 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-27c67584-4eab-4b09-a92f-9011a89bc2e7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.204117 Dec 07 18:45:19.781495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 52/107] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:19 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:20.619164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:20.619771 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:20.625964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:20.626420 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:20.627262 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:20.627622 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:20.800422 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:20.802146 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:20.813485 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:20.816786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:20.817893 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:20.820982 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:20.855084 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:20.866369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-74d45d38-39c5-47b2-b1d6-a53844c5ae15 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1322 microversion: 2.1 time: 0.251762 Dec 07 18:45:20.868232 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 56/108] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:20 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:21.032826 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:21.041645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5c2255ef-8996-46b0-b743-5f71c94d3f39 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1363 microversion: 2.1 time: 0.246100 Dec 07 18:45:21.042303 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 53/109] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:20 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:21.887652 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:21.888508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:21.895530 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:21.896212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:21.897636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:21.898778 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:21.996278 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-466532143", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "c8b8ce23-5289-4bad-a75a-485ea880ca99"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:22.072065 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] validate_networks() for [('c8b8ce23-5289-4bad-a75a-485ea880ca99', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:45:22.170248 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:22.189449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3cc0e741-a426-4786-8f93-183d7d77ada2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1517 microversion: 2.1 time: 0.305237 Dec 07 18:45:22.191564 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 57/110] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:21 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1517 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:22.201364 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:22.202176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:22.230151 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.230604 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.232057 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.232622 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.399281 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:22.407245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9f102128-6220-4b61-aa35-cab4c0007be0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1550 microversion: 2.1 time: 0.214823 Dec 07 18:45:22.408004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 58/111] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:22 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1550 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:22.412855 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:22.414584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:22.421980 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.422619 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.423720 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.424311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.455611 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lazy-loading 'flavor' on Instance uuid fb9b1241-e140-4789-9341-cb20006c6eba {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:45:22.572840 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:45:22.573612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:45:22.574397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:45:22.574981 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:45:22.575611 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:45:22.588931 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.589682 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.590852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.591685 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.605830 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c084b8b8-c0f6-423c-9eda-e546e8e3f8f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba/action" status: 200 len: 32 microversion: 2.1 time: 0.196289 Dec 07 18:45:22.606893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 59/112] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:22 2021] POST /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:22.610950 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:45:22.615319 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for user be5301c42eaa4538800ccab20dfc9b7c and project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:45:22.618326 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8483cd5e-9e9b-4021-abe7-e3c580482866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:22.619182 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8483cd5e-9e9b-4021-abe7-e3c580482866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:22.627080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8483cd5e-9e9b-4021-abe7-e3c580482866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.627810 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8483cd5e-9e9b-4021-abe7-e3c580482866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.628567 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:45:22.629179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8483cd5e-9e9b-4021-abe7-e3c580482866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.629750 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8483cd5e-9e9b-4021-abe7-e3c580482866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.631841 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:45:22.704717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4c92d130-8d27-4b2c-bf88-b35a7b6a0f85 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713578 Dec 07 18:45:22.705968 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 54/113] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:45:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 07 18:45:22.712244 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:22.714047 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:22.722075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.722781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.724279 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:22.725155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:22.836166 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8483cd5e-9e9b-4021-abe7-e3c580482866 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223650 Dec 07 18:45:22.836740 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 60/114] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Dec 7 18:45:22 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:22.849681 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c7a1cd67-a4b6-4d2a-a812-309cc183038e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:22.850390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c7a1cd67-a4b6-4d2a-a812-309cc183038e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:23.152096 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c7a1cd67-a4b6-4d2a-a812-309cc183038e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:23.170930 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c7a1cd67-a4b6-4d2a-a812-309cc183038e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1217 microversion: 2.1 time: 0.331267 Dec 07 18:45:23.172856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 61/115] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:22 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1217 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:23.498539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:23.508979 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1ec90585-b924-477a-80d2-6842765e42dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.801542 Dec 07 18:45:23.509628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 55/116] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:22 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:24.189680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:24.191256 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:24.209866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:24.215362 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:24.216357 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:24.216640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:24.370593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:24.380802 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-eb793238-4e69-42e4-b2f5-cdd031a6a3b0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1269 microversion: 2.1 time: 0.195660 Dec 07 18:45:24.381930 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 62/117] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:24 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1269 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:24.527461 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:24.528156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:24.542956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:24.546463 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:24.547994 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:24.548960 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:24.862658 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:24.871278 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2f6c6b45-73e1-4375-aebd-6908b37078b1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.349092 Dec 07 18:45:24.871860 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 56/118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:24 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:25.105061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5db85bfc-6632-44a4-828a-6fc930962945 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:25.110120 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-f9a6fc3f-9564-42d3-b5a0-25d00a9438d9 req-36049bb9-12cb-4f06-9bce-d527e88a2c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "668cc429-6322-4b0b-8f3a-6d910c891444", "tag": "74f0e008-eb9a-47c1-abf0-a78d47978293"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:25.111775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5db85bfc-6632-44a4-828a-6fc930962945 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:25.114241 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:25.114241 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:45:25.127518 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5db85bfc-6632-44a4-828a-6fc930962945 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:25.127965 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5db85bfc-6632-44a4-828a-6fc930962945 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:25.128831 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5db85bfc-6632-44a4-828a-6fc930962945 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:25.129320 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5db85bfc-6632-44a4-828a-6fc930962945 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:25.137805 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-f9a6fc3f-9564-42d3-b5a0-25d00a9438d9 req-36049bb9-12cb-4f06-9bce-d527e88a2c58 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:25.138426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-f9a6fc3f-9564-42d3-b5a0-25d00a9438d9 req-36049bb9-12cb-4f06-9bce-d527e88a2c58 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:25.174035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-f9a6fc3f-9564-42d3-b5a0-25d00a9438d9 req-36049bb9-12cb-4f06-9bce-d527e88a2c58 service nova] Creating event network-changed:74f0e008-eb9a-47c1-abf0-a78d47978293 for instance 668cc429-6322-4b0b-8f3a-6d910c891444 on hv-cinder-81969 Dec 07 18:45:25.190943 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-f9a6fc3f-9564-42d3-b5a0-25d00a9438d9 req-36049bb9-12cb-4f06-9bce-d527e88a2c58 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084168 Dec 07 18:45:25.196387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 57/119] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:45:25.262907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5db85bfc-6632-44a4-828a-6fc930962945 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.162135 Dec 07 18:45:25.266096 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 63/120] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:25 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:25.398996 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:25.399927 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:25.414075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:25.415117 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:25.416093 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:25.416706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:25.549939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:25.558984 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c167db90-b868-4736-9276-d5bde4eb958a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1275 microversion: 2.1 time: 0.164213 Dec 07 18:45:25.559562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 58/121] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:25 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:25.889177 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:25.890304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:25.900085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:25.909943 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:25.911189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:25.911866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:26.224794 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:26.233674 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ffaf9c36-9dfa-4578-9bf4-3eab330af9ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.348508 Dec 07 18:45:26.244832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 64/122] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:25 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:26.275717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-70a10d09-ecc9-4533-b455-f881ee34451a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:26.275717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-70a10d09-ecc9-4533-b455-f881ee34451a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:26.284691 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a10d09-ecc9-4533-b455-f881ee34451a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:26.285738 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a10d09-ecc9-4533-b455-f881ee34451a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:26.287131 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a10d09-ecc9-4533-b455-f881ee34451a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:26.288609 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a10d09-ecc9-4533-b455-f881ee34451a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:26.382410 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-70a10d09-ecc9-4533-b455-f881ee34451a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.112110 Dec 07 18:45:26.383881 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 59/123] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:26 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:26.577759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:26.579007 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:26.589689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:26.590803 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:26.592331 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:26.592924 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:26.847758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:26.858717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ed614801-6092-4130-a5e1-a9f8cacaff9e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.285768 Dec 07 18:45:26.861550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 65/124] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:26 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:27.251237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:27.252770 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:27.261296 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:27.262589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:27.264220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:27.265428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:27.393760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-48ecdab5-f30c-4f4a-8a6c-b7f15a127c66 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:27.394751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-48ecdab5-f30c-4f4a-8a6c-b7f15a127c66 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:27.413642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-48ecdab5-f30c-4f4a-8a6c-b7f15a127c66 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:27.414449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-48ecdab5-f30c-4f4a-8a6c-b7f15a127c66 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:27.415422 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-48ecdab5-f30c-4f4a-8a6c-b7f15a127c66 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:27.416005 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-48ecdab5-f30c-4f4a-8a6c-b7f15a127c66 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:27.522185 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-48ecdab5-f30c-4f4a-8a6c-b7f15a127c66 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.131778 Dec 07 18:45:27.525235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 66/125] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:27 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 07 18:45:27.588432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-6bc80595-9c4f-4fdb-95c7-dd511d76734c req-e0ab5392-5531-488d-ba0f-c32a2a31efc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e2d7c4-b135-4871-9753-659f8c3cfaf1", "tag": "b08af1cd-2e39-4c70-8061-c097c902fc64"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:27.589657 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:27.589657 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:27.602382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-6bc80595-9c4f-4fdb-95c7-dd511d76734c req-e0ab5392-5531-488d-ba0f-c32a2a31efc9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:27.602879 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-6bc80595-9c4f-4fdb-95c7-dd511d76734c req-e0ab5392-5531-488d-ba0f-c32a2a31efc9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:27.612272 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:27.624919 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6054380f-f6e3-4cf9-8f66-821dd0847657 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.377509 Dec 07 18:45:27.626632 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 60/126] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:27 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:27.636293 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-6bc80595-9c4f-4fdb-95c7-dd511d76734c req-e0ab5392-5531-488d-ba0f-c32a2a31efc9 service nova] Creating event network-changed:b08af1cd-2e39-4c70-8061-c097c902fc64 for instance 15e2d7c4-b135-4871-9753-659f8c3cfaf1 on hv-cinder-81969 Dec 07 18:45:27.643344 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-6bc80595-9c4f-4fdb-95c7-dd511d76734c req-e0ab5392-5531-488d-ba0f-c32a2a31efc9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060463 Dec 07 18:45:27.644414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 67/127] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:45:27.879525 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:27.880137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:27.887663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:27.888140 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:27.888922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:27.889352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.256074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:28.269007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-aec2c2bf-3a18-4514-9dcb-6a1bf4b6e991 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.393728 Dec 07 18:45:28.271730 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 61/128] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:27 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:28.438523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:28.439629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:28.448565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.449358 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.450425 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.451052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.489383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:45:28.533808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bb327b6e-f00f-441e-b56d-2e5b852b4827 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:28.534994 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bb327b6e-f00f-441e-b56d-2e5b852b4827 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:28.542776 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bb327b6e-f00f-441e-b56d-2e5b852b4827 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.545286 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bb327b6e-f00f-441e-b56d-2e5b852b4827 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.548140 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bb327b6e-f00f-441e-b56d-2e5b852b4827 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.555975 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bb327b6e-f00f-441e-b56d-2e5b852b4827 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.634061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-06dbde3c-57ff-439f-b5a7-76b0777dee71 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "DELETE /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 204 len: 0 microversion: 2.1 time: 0.207605 Dec 07 18:45:28.635793 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 68/129] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:45:28 2021] DELETE /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:45:28.649389 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:28.650367 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:28.657523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.658343 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.661481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.662236 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.675119 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bb327b6e-f00f-441e-b56d-2e5b852b4827 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.144396 Dec 07 18:45:28.678196 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 62/130] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:28 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:28.681769 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:28.683145 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:28.696221 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.696688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.697476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:28.697938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:28.948505 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:28.966818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-55def6f1-267d-459f-aefa-376d81e886b0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1555 microversion: 2.1 time: 0.323747 Dec 07 18:45:28.969530 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 69/131] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:28 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1555 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:28.979329 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:28.993660 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b414a5e1-b3e8-42d6-bcb2-02268fad2364 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.316530 Dec 07 18:45:28.994601 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 63/132] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:28 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:29.287351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:29.287906 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:29.294671 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:29.295116 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:29.295896 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:29.296541 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:29.636332 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:29.646654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-05ab2b25-5a50-49de-b985-21f501b9df82 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.360739 Dec 07 18:45:29.647414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 70/133] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:29 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:29.685755 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9c78f1a0-671a-48a0-a113-d391b4ab280d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:29.686684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9c78f1a0-671a-48a0-a113-d391b4ab280d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:29.697619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c78f1a0-671a-48a0-a113-d391b4ab280d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:29.699628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c78f1a0-671a-48a0-a113-d391b4ab280d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:29.704088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c78f1a0-671a-48a0-a113-d391b4ab280d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:29.705460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c78f1a0-671a-48a0-a113-d391b4ab280d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:29.808283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9c78f1a0-671a-48a0-a113-d391b4ab280d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.125929 Dec 07 18:45:29.811647 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 64/134] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:29 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:29.987559 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:29.987559 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:29.994756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:29.995435 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:29.996654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:29.997237 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:30.012311 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:30.013652 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:30.030115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:30.031020 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:30.033684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:30.035746 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:30.318965 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:30.332985 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7d060912-52da-41b5-8300-7ba27a15f765 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.325906 Dec 07 18:45:30.334037 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 65/135] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:30 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:30.406326 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:30.424197 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-899a6a8f-28c3-41e1-afcc-6b1826e78f9d tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1555 microversion: 2.1 time: 0.441609 Dec 07 18:45:30.443859 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 71/136] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:29 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1555 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:30.665846 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:30.666921 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:30.673675 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:30.674551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:30.675725 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:30.676489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:30.819910 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dafdca41-2713-4e1f-a59b-f4c74bbd07c0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:30.821500 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dafdca41-2713-4e1f-a59b-f4c74bbd07c0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:30.827171 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dafdca41-2713-4e1f-a59b-f4c74bbd07c0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:30.827814 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dafdca41-2713-4e1f-a59b-f4c74bbd07c0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:30.828666 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dafdca41-2713-4e1f-a59b-f4c74bbd07c0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:30.829168 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dafdca41-2713-4e1f-a59b-f4c74bbd07c0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:30.900916 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dafdca41-2713-4e1f-a59b-f4c74bbd07c0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.084306 Dec 07 18:45:30.902133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 72/137] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:30 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:31.002607 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:31.016508 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d447473a-64b2-40a0-b84c-dfb2682375f0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.355814 Dec 07 18:45:31.025956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 66/138] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:30 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:31.350360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:31.351582 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:31.359071 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:31.359515 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:31.360296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:31.360722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:31.453741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:31.454391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:31.464431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:31.464887 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:31.465681 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:31.466140 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:31.570581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:31.588538 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5b57afe0-52fe-4ca7-ab48-1bf7c569fb6e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.240647 Dec 07 18:45:31.590287 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 73/139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:31 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:31.912457 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d8804b66-ffa0-4b35-b5bd-01348b85a91b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:31.914453 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d8804b66-ffa0-4b35-b5bd-01348b85a91b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:31.925074 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8804b66-ffa0-4b35-b5bd-01348b85a91b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:31.927066 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8804b66-ffa0-4b35-b5bd-01348b85a91b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:31.930479 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8804b66-ffa0-4b35-b5bd-01348b85a91b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:31.930914 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8804b66-ffa0-4b35-b5bd-01348b85a91b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:32.032313 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d8804b66-ffa0-4b35-b5bd-01348b85a91b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.123320 Dec 07 18:45:32.033533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 74/140] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:31 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:32.040900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:32.047362 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:32.059888 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:32.060823 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:32.062540 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:32.063800 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:32.064455 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:32.081352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1e128c74-85bf-46c0-b7c8-01c12b9093d0 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1555 microversion: 2.1 time: 0.634737 Dec 07 18:45:32.090305 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 67/141] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:31 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1555 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:32.274246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:32.283295 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-20b26259-9e2d-4b11-af1c-02abdc13b32a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.248261 Dec 07 18:45:32.287288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 75/142] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:32 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:32.614657 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:32.619793 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:32.634332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:32.634788 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:32.635585 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:32.636022 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:32.669408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-c41c1d47-5bf6-4317-bb02-72f95aec3e9c req-e91b6ac4-696f-44ec-b52b-a16944abbba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8", "name": "network-vif-deleted", "tag": "a7b6886d-664d-4ad4-b0e0-be7fe72c4fdb"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:32.673722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:32.673722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:32.702857 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-c41c1d47-5bf6-4317-bb02-72f95aec3e9c req-e91b6ac4-696f-44ec-b52b-a16944abbba3 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:32.705266 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-c41c1d47-5bf6-4317-bb02-72f95aec3e9c req-e91b6ac4-696f-44ec-b52b-a16944abbba3 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:32.743873 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-c41c1d47-5bf6-4317-bb02-72f95aec3e9c req-e91b6ac4-696f-44ec-b52b-a16944abbba3 service nova] Creating event network-vif-deleted:a7b6886d-664d-4ad4-b0e0-be7fe72c4fdb for instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 on hv-cinder-81969 Dec 07 18:45:32.756345 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-c41c1d47-5bf6-4317-bb02-72f95aec3e9c req-e91b6ac4-696f-44ec-b52b-a16944abbba3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090041 Dec 07 18:45:32.762377 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 76/143] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:45:33.025218 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:33.035426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7e27afb4-5d09-48d0-a010-4ec70390266e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.430953 Dec 07 18:45:33.043933 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f41b5d31-d4f0-4a2f-9027-e7007770732f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:33.045606 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f41b5d31-d4f0-4a2f-9027-e7007770732f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:33.048046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 68/144] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:32 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:33.054568 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f41b5d31-d4f0-4a2f-9027-e7007770732f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:33.071559 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f41b5d31-d4f0-4a2f-9027-e7007770732f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:33.076060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f41b5d31-d4f0-4a2f-9027-e7007770732f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:33.077306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f41b5d31-d4f0-4a2f-9027-e7007770732f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:33.102936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:33.103537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:33.112897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:33.120988 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:33.122496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:33.123097 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:33.217044 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f41b5d31-d4f0-4a2f-9027-e7007770732f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.176779 Dec 07 18:45:33.218513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 77/145] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:33 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 07 18:45:33.292614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c477cff657ed43f0bbb2040c0514bf92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cf66e1a2b384f8abac34fbb53354039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:33.301184 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:33.302073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:33.303672 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8ccd4274-e289-464d-b897-694f20920539 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 200 len: 1346 microversion: 2.1 time: 0.203264 Dec 07 18:45:33.306894 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 69/146] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:33 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 1346 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:33.324034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:33.326529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:33.327680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:33.330516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:33.709374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:33.734866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-92ca398e-2664-4221-afda-2601a4d9426c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.438125 Dec 07 18:45:33.735459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 78/147] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:33 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:34.054767 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:34.055923 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:34.075784 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.076240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.077538 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.078389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.230584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-78f646dd-f87e-4420-a0b8-54a8fb2e8b8b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:34.231807 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-78f646dd-f87e-4420-a0b8-54a8fb2e8b8b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:34.243572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f646dd-f87e-4420-a0b8-54a8fb2e8b8b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.244022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f646dd-f87e-4420-a0b8-54a8fb2e8b8b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.245117 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f646dd-f87e-4420-a0b8-54a8fb2e8b8b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.245622 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f646dd-f87e-4420-a0b8-54a8fb2e8b8b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.344089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-78f646dd-f87e-4420-a0b8-54a8fb2e8b8b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.117931 Dec 07 18:45:34.346858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 79/148] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:34 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:34.358376 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-eb4de7df-b31d-4eef-acad-1be0de5acfeb req-492460fb-b812-444a-afdf-76eeed5fc8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e2d7c4-b135-4871-9753-659f8c3cfaf1", "name": "network-vif-plugged", "status": "completed", "tag": "b08af1cd-2e39-4c70-8061-c097c902fc64"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:34.360252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:34.360252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:34.380221 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-eb4de7df-b31d-4eef-acad-1be0de5acfeb req-492460fb-b812-444a-afdf-76eeed5fc8ed service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.381996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-eb4de7df-b31d-4eef-acad-1be0de5acfeb req-492460fb-b812-444a-afdf-76eeed5fc8ed service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.402545 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-eb4de7df-b31d-4eef-acad-1be0de5acfeb req-492460fb-b812-444a-afdf-76eeed5fc8ed service nova] Creating event network-vif-plugged:b08af1cd-2e39-4c70-8061-c097c902fc64 for instance 15e2d7c4-b135-4871-9753-659f8c3cfaf1 on hv-cinder-81969 Dec 07 18:45:34.411296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-eb4de7df-b31d-4eef-acad-1be0de5acfeb req-492460fb-b812-444a-afdf-76eeed5fc8ed service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059993 Dec 07 18:45:34.412319 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 80/149] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:34.418715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:34.419725 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:34.442764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.443670 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.447922 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.448996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.472178 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] HTTP exception thrown: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. Dec 07 18:45:34.473060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Returning 404 to user: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:45:34.474290 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e746bba1-9283-447a-b9d0-e373dee1d565 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 404 len: 111 microversion: 2.1 time: 0.060043 Dec 07 18:45:34.477479 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 81/150] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:34 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:45:34.641270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:34.652489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-03e728aa-a4d3-4a8d-9823-24bd4b927173 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.603556 Dec 07 18:45:34.670735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 70/151] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:34 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:34.694955 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:34.696097 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:34.707594 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.708078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.713201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.713666 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.741967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] HTTP exception thrown: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. Dec 07 18:45:34.746791 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Returning 404 to user: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:45:34.748078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2cce446a-15e0-4d7d-b866-e67d264f9027 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063628 Dec 07 18:45:34.749824 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 82/152] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:45:34 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:45:34.758027 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:34.758872 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:34.773882 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.774923 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:34.778052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:34.779036 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:35.303394 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:35.312470 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-814205bb-c292-4a96-a57c-73597b8dbd04 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.558144 Dec 07 18:45:35.323235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 71/153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:34 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:35.357557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a377f635-9f8f-413e-82e8-da379708da00 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:35.359079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a377f635-9f8f-413e-82e8-da379708da00 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:35.371270 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a377f635-9f8f-413e-82e8-da379708da00 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:35.373481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a377f635-9f8f-413e-82e8-da379708da00 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:35.374477 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a377f635-9f8f-413e-82e8-da379708da00 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:35.374839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a377f635-9f8f-413e-82e8-da379708da00 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:35.486537 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a377f635-9f8f-413e-82e8-da379708da00 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.133248 Dec 07 18:45:35.487188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 83/154] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:35 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:35.677314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:35.678208 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:35.688088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:35.688543 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:35.691719 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:35.692171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.088906 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:36.089620 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:36.097314 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.098180 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.099187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.099819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.127816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] HTTP exception thrown: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. Dec 07 18:45:36.129962 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Returning 404 to user: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:45:36.135715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d152927f-3a14-4279-986a-449fbdca4727 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "DELETE /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 404 len: 111 microversion: 2.1 time: 0.051962 Dec 07 18:45:36.136956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 84/155] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:45:36 2021] DELETE /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:45:36.146360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:36.147373 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] [instance: 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:36.157618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.158335 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.160451 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.161255 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.180964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] HTTP exception thrown: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. Dec 07 18:45:36.181933 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] Returning 404 to user: Instance 35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:45:36.183662 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dabda1f4-514b-4abf-aa6b-91cbe8690bb7 tempest-DeleteServersTestJSON-220273030 tempest-DeleteServersTestJSON-220273030-project] 10.222.0.41 "GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8" status: 404 len: 111 microversion: 2.1 time: 0.042090 Dec 07 18:45:36.184477 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 85/156] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:36 2021] GET /compute/v2.1/servers/35bdb6f2-cd06-40ea-9577-3dd7fb4cdcc8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:45:36.211155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:36.220584 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-75ba71b1-a3a6-4f73-916b-73b20c68ed62 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.546832 Dec 07 18:45:36.222061 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 72/157] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:35 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:36.331268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:36.332564 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:36.346459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.348876 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.350913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.353800 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.500245 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e2fd39d8-c364-4119-a80d-d56703346278 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:36.501787 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e2fd39d8-c364-4119-a80d-d56703346278 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:36.516393 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2fd39d8-c364-4119-a80d-d56703346278 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.517766 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2fd39d8-c364-4119-a80d-d56703346278 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.518863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2fd39d8-c364-4119-a80d-d56703346278 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:36.520083 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2fd39d8-c364-4119-a80d-d56703346278 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:36.671714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e2fd39d8-c364-4119-a80d-d56703346278 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.173785 Dec 07 18:45:36.672631 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 73/158] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:36 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:36.809199 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:36.826416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1f220eb7-9bdb-4a74-8695-2e78d0bf768e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1317 microversion: 2.1 time: 0.498971 Dec 07 18:45:36.836137 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 86/159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:36 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:37.244406 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:37.248963 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:37.260867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:37.261628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:37.262663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:37.263290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:37.507186 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:37.516192 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d395d023-6b79-4cbe-b969-0a256b767a68 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.280462 Dec 07 18:45:37.518550 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 74/160] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:37 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:37.684096 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-91c36c3f-317a-4bd9-a1e6-e9d9eaa894af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:37.685000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-91c36c3f-317a-4bd9-a1e6-e9d9eaa894af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:37.699334 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91c36c3f-317a-4bd9-a1e6-e9d9eaa894af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:37.701592 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91c36c3f-317a-4bd9-a1e6-e9d9eaa894af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:37.705198 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91c36c3f-317a-4bd9-a1e6-e9d9eaa894af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:37.707414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91c36c3f-317a-4bd9-a1e6-e9d9eaa894af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:37.832414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-91c36c3f-317a-4bd9-a1e6-e9d9eaa894af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 14 microversion: 2.1 time: 0.152230 Dec 07 18:45:37.833089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 87/161] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:37 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:37.848000 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:37.849068 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:37.864429 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:37.865647 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:37.869645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:37.871977 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.364641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:38.380118 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-54703903-5765-4117-bdbd-467f997e70ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1507 microversion: 2.1 time: 0.538340 Dec 07 18:45:38.381661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 75/162] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:37 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1507 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:38.400816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dba477f8-2295-4fd1-a895-7ad2cc3e8c24"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:38.401983 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:38.418212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.420862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.421704 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.422163 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.539305 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:38.539548 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:38.550714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.552891 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.554373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.554814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.610634 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] HTTP exception thrown: Invalid volume: volume dba477f8-2295-4fd1-a895-7ad2cc3e8c24 is already attached to instances: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d Dec 07 18:45:38.611291 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Returning 400 to user: Invalid volume: volume dba477f8-2295-4fd1-a895-7ad2cc3e8c24 is already attached to instances: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:45:38.612124 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b2651021-3848-4db2-9531-b83f27b3d8cd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.218255 Dec 07 18:45:38.615387 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 88/163] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:45:38 2021] POST /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1/os-volume_attachments => generated 174 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 07 18:45:38.779997 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:38.781134 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:38.818380 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.822961 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.824886 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.825320 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.925181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:38.935459 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-89b5f7c7-924b-4c5f-af8f-9f9fb41bdf4c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.403164 Dec 07 18:45:38.936071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 76/164] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:38 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:38.945717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0cf6c7f7-fa30-45ef-af3e-dae3eff5554b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:38.947194 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0cf6c7f7-fa30-45ef-af3e-dae3eff5554b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:38.954873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cf6c7f7-fa30-45ef-af3e-dae3eff5554b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.955982 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cf6c7f7-fa30-45ef-af3e-dae3eff5554b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:38.957004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cf6c7f7-fa30-45ef-af3e-dae3eff5554b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:38.957706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cf6c7f7-fa30-45ef-af3e-dae3eff5554b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:39.081021 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0cf6c7f7-fa30-45ef-af3e-dae3eff5554b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 3123 microversion: 2.1 time: 0.143350 Dec 07 18:45:39.081843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 77/165] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:38 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 3123 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:39.162297 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lazy-loading 'services' on Instance uuid 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:45:39.693775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-704315ba-52a2-4a8d-bc2c-63f821485e53 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "DELETE /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments/dba477f8-2295-4fd1-a895-7ad2cc3e8c24" status: 202 len: 0 microversion: 2.1 time: 0.918003 Dec 07 18:45:39.695461 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 89/166] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:45:38 2021] DELETE /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments/dba477f8-2295-4fd1-a895-7ad2cc3e8c24 => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:45:39.710824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7ee58499-88b8-4bc9-af76-94b411f73a9b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:39.716008 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7ee58499-88b8-4bc9-af76-94b411f73a9b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:39.738409 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7ee58499-88b8-4bc9-af76-94b411f73a9b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:39.739312 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7ee58499-88b8-4bc9-af76-94b411f73a9b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:39.741023 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7ee58499-88b8-4bc9-af76-94b411f73a9b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:39.742134 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7ee58499-88b8-4bc9-af76-94b411f73a9b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:39.793243 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7ee58499-88b8-4bc9-af76-94b411f73a9b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093024 Dec 07 18:45:39.794501 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 78/167] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:45:39 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:39.954522 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:39.956115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:39.967889 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:39.968660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:39.969850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:39.970534 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:40.094219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4dee78a4-3580-4b66-aab4-faaf810c87ec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:40.096211 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4dee78a4-3580-4b66-aab4-faaf810c87ec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:40.105597 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4dee78a4-3580-4b66-aab4-faaf810c87ec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:40.107042 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4dee78a4-3580-4b66-aab4-faaf810c87ec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:40.108318 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4dee78a4-3580-4b66-aab4-faaf810c87ec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:40.109537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4dee78a4-3580-4b66-aab4-faaf810c87ec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:40.220580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4dee78a4-3580-4b66-aab4-faaf810c87ec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 11207 microversion: 2.1 time: 0.132015 Dec 07 18:45:40.221231 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 79/168] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:40 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 11207 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:45:40.676630 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:40.699745 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-64c12fb7-888e-4dfa-af2b-772a2786db49 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.746576 Dec 07 18:45:40.705664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 90/169] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:39 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:40.806785 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-dcf7870b-eb5b-4979-91e2-0dc4aedc3430 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:40.808604 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-dcf7870b-eb5b-4979-91e2-0dc4aedc3430 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:40.824379 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dcf7870b-eb5b-4979-91e2-0dc4aedc3430 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:40.826455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dcf7870b-eb5b-4979-91e2-0dc4aedc3430 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:40.828220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dcf7870b-eb5b-4979-91e2-0dc4aedc3430 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:40.830273 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dcf7870b-eb5b-4979-91e2-0dc4aedc3430 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:40.935357 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-dcf7870b-eb5b-4979-91e2-0dc4aedc3430 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.133045 Dec 07 18:45:40.935967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 80/170] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:45:40 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d/os-volume_attachments => generated 25 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:45:41.250454 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d686e644-89ba-4b2f-88b6-0410b884af88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:41.251964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d686e644-89ba-4b2f-88b6-0410b884af88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:41.270679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d686e644-89ba-4b2f-88b6-0410b884af88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:41.273744 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d686e644-89ba-4b2f-88b6-0410b884af88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:41.278084 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d686e644-89ba-4b2f-88b6-0410b884af88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:41.278801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d686e644-89ba-4b2f-88b6-0410b884af88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:41.284899 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117308556", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "c8b8ce23-5289-4bad-a75a-485ea880ca99"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:41.374322 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] validate_networks() for [('c8b8ce23-5289-4bad-a75a-485ea880ca99', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:45:41.427992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d686e644-89ba-4b2f-88b6-0410b884af88 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 16319 microversion: 2.1 time: 0.196994 Dec 07 18:45:41.429181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 91/171] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:41 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 16319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:41.720739 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:41.722261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:41.729750 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:41.730513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:41.731882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:41.732513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:42.107670 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:42.117697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e83737d7-fd3f-4c27-8e10-fb92ec67bbbe tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.399755 Dec 07 18:45:42.122941 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 92/172] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:41 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:42.442741 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3ed4ae37-daf1-45a1-a468-2d878e340f02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:42.443869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3ed4ae37-daf1-45a1-a468-2d878e340f02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:42.463447 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae37-daf1-45a1-a468-2d878e340f02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:42.463905 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae37-daf1-45a1-a468-2d878e340f02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:42.464713 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae37-daf1-45a1-a468-2d878e340f02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:42.465139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ed4ae37-daf1-45a1-a468-2d878e340f02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:42.474271 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:45:42.476200 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:45:42.476906 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:45:42.477526 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:45:42.478172 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:45:42.493652 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:42.494280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:42.496593 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:42.498993 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:42.547335 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:45:42.559704 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for user be5301c42eaa4538800ccab20dfc9b7c and project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:45:42.584013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3ed4ae37-daf1-45a1-a468-2d878e340f02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 18109 microversion: 2.1 time: 0.146576 Dec 07 18:45:42.584977 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 93/173] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:42 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 18109 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:42.610738 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:45:42.613053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:45:42.701611 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0b372a14-051c-4a76-b6ec-c60030647f43 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.415947 Dec 07 18:45:42.703100 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 81/174] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:45:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 07 18:45:42.717581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e097d710-ffde-4dde-b3d4-46521dcc0b0a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:42.718596 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e097d710-ffde-4dde-b3d4-46521dcc0b0a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:43.034145 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e097d710-ffde-4dde-b3d4-46521dcc0b0a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:43.044066 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e097d710-ffde-4dde-b3d4-46521dcc0b0a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1218 microversion: 2.1 time: 0.333719 Dec 07 18:45:43.045675 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 94/175] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:42 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1218 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:43.144388 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:43.145693 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:43.155428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:43.159064 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:43.161062 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:43.163210 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:43.468505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:43.482184 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-94bcdbc4-2767-46eb-8caf-5955615ca848 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.345013 Dec 07 18:45:43.483836 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 82/176] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:43 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:43.598484 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-23c4cb66-2a1b-49f0-9966-b8a9ca260f85 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:43.600112 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-23c4cb66-2a1b-49f0-9966-b8a9ca260f85 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:43.627904 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23c4cb66-2a1b-49f0-9966-b8a9ca260f85 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:43.628356 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23c4cb66-2a1b-49f0-9966-b8a9ca260f85 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:43.629153 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23c4cb66-2a1b-49f0-9966-b8a9ca260f85 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:43.629589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23c4cb66-2a1b-49f0-9966-b8a9ca260f85 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:43.770035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-23c4cb66-2a1b-49f0-9966-b8a9ca260f85 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 19523 microversion: 2.1 time: 0.176487 Dec 07 18:45:43.771308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 95/177] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:43 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 19523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:44.062682 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:44.063579 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:44.075205 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:44.082570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:44.083401 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:44.083836 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:44.213979 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:44.223830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-84959df8-1a75-4fa7-93f6-538569358c8a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1270 microversion: 2.1 time: 0.165797 Dec 07 18:45:44.225748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 83/178] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:44 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:44.500398 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:44.503861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:44.522239 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:44.522717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:44.523502 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:44.523926 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:44.784478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6ce2fdb0-532c-4460-85b8-1ab14a721fcd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:44.785458 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6ce2fdb0-532c-4460-85b8-1ab14a721fcd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:44.802546 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6ce2fdb0-532c-4460-85b8-1ab14a721fcd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:44.803245 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6ce2fdb0-532c-4460-85b8-1ab14a721fcd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:44.805401 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6ce2fdb0-532c-4460-85b8-1ab14a721fcd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:44.806365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6ce2fdb0-532c-4460-85b8-1ab14a721fcd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:44.937285 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6ce2fdb0-532c-4460-85b8-1ab14a721fcd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 22014 microversion: 2.1 time: 0.157734 Dec 07 18:45:44.938329 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 84/179] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:44 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 22014 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:45.243135 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:45.243834 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:45.279466 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:45.288909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:45.289362 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:45.290174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:45.290600 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:45.308574 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4653be44-f413-4d0b-ac90-36b5c43454cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.812243 Dec 07 18:45:45.311273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 96/180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:44 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:45.452042 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:45.467608 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3c327b27-9577-4ad5-9328-5ebedb0633ad tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1276 microversion: 2.1 time: 0.228860 Dec 07 18:45:45.480323 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 85/181] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:45 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:45.950496 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-451844fe-0636-4e4b-ad04-a3c8b294153b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:45.951996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-451844fe-0636-4e4b-ad04-a3c8b294153b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:45.961167 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-451844fe-0636-4e4b-ad04-a3c8b294153b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:45.967014 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-451844fe-0636-4e4b-ad04-a3c8b294153b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:45.967837 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-451844fe-0636-4e4b-ad04-a3c8b294153b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:45.968268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-451844fe-0636-4e4b-ad04-a3c8b294153b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:46.065823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-451844fe-0636-4e4b-ad04-a3c8b294153b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 23435 microversion: 2.1 time: 0.120180 Dec 07 18:45:46.066509 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 97/182] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:45 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 23435 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:46.325871 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:46.326481 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:46.336100 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:46.341788 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:46.345860 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:46.346639 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:46.842572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ae0c3a2a-ab92-4d1b-95a0-73a51a9c4860 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Action: 'create', calling method: .version_select at 0x7f1998c153a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1526245359"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:46.908150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-ae0c3a2a-ab92-4d1b-95a0-73a51a9c4860 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Getting quotas for project 9dbb7c47db4047b7b6b9fdc130ea461d. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:45:46.927799 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-ae0c3a2a-ab92-4d1b-95a0-73a51a9c4860 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Getting quotas for user 7eb48055ae8141bbb31e920aba3f6763 and project 9dbb7c47db4047b7b6b9fdc130ea461d. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:45:47.492954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:47.502243 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1c68de26-a8ca-4350-bb3b-98e56b174f48 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 1.180835 Dec 07 18:45:47.513519 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 86/183] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:46 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:47.519760 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:47.520478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:47.530049 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:47.542646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:47.543831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:47.544471 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:47.547958 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-ae0c3a2a-ab92-4d1b-95a0-73a51a9c4860 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Getting quotas for project 9dbb7c47db4047b7b6b9fdc130ea461d. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:45:47.556856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-ae0c3a2a-ab92-4d1b-95a0-73a51a9c4860 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Getting quotas for user 7eb48055ae8141bbb31e920aba3f6763 and project 9dbb7c47db4047b7b6b9fdc130ea461d. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:45:47.579306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ae0c3a2a-ab92-4d1b-95a0-73a51a9c4860 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 1.100640 Dec 07 18:45:47.582081 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 98/184] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Dec 7 18:45:46 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:47.590005 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9da3dc4f-99ae-4af1-9afa-53d59c1cec4c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:47.591648 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9da3dc4f-99ae-4af1-9afa-53d59c1cec4c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:47.599016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4f-99ae-4af1-9afa-53d59c1cec4c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:47.599656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4f-99ae-4af1-9afa-53d59c1cec4c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:47.600833 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4f-99ae-4af1-9afa-53d59c1cec4c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:47.601786 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9da3dc4f-99ae-4af1-9afa-53d59c1cec4c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:47.692478 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9da3dc4f-99ae-4af1-9afa-53d59c1cec4c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 25275 microversion: 2.1 time: 0.108183 Dec 07 18:45:47.693404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 99/185] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:47 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 25275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:47.840487 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:47.848077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ba07c65a-5ad5-4b70-ad8e-ceec3605359b tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 0.332807 Dec 07 18:45:47.859750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 87/186] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:47 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:48.201857 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-e4981353-4c2b-4b0c-b549-dd78a309800c req-1f14de2b-3c31-47c2-9a32-cac2cee46545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd63ffe-4565-42f6-8f7c-9f83cda248e8", "tag": "1b17425e-406c-49a0-9e23-08dbf104898d"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:48.204579 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:48.204579 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:48.237684 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-e4981353-4c2b-4b0c-b549-dd78a309800c req-1f14de2b-3c31-47c2-9a32-cac2cee46545 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:48.238812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-e4981353-4c2b-4b0c-b549-dd78a309800c req-1f14de2b-3c31-47c2-9a32-cac2cee46545 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:48.274308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-e4981353-4c2b-4b0c-b549-dd78a309800c req-1f14de2b-3c31-47c2-9a32-cac2cee46545 service nova] Creating event network-changed:1b17425e-406c-49a0-9e23-08dbf104898d for instance 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 on hv-cinder-81969 Dec 07 18:45:48.290690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-e4981353-4c2b-4b0c-b549-dd78a309800c req-1f14de2b-3c31-47c2-9a32-cac2cee46545 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095381 Dec 07 18:45:48.295572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 100/187] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:48.539575 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:48.540724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:48.558522 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:48.559060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:48.566823 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:48.567386 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:48.706826 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f07e12b2-fd47-4074-8d18-9935136b0c6a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:48.708690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f07e12b2-fd47-4074-8d18-9935136b0c6a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:48.729524 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f07e12b2-fd47-4074-8d18-9935136b0c6a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:48.731006 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f07e12b2-fd47-4074-8d18-9935136b0c6a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:48.732012 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f07e12b2-fd47-4074-8d18-9935136b0c6a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:48.732639 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f07e12b2-fd47-4074-8d18-9935136b0c6a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:48.833244 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f07e12b2-fd47-4074-8d18-9935136b0c6a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 26327 microversion: 2.1 time: 0.131899 Dec 07 18:45:48.835144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 101/188] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:48 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 26327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:48.883759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:48.885107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:48.894851 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:48.895537 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:48.896502 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:48.897680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:49.230437 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:49.244412 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-30dec94d-7b85-442d-b5e2-44811638131f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.714787 Dec 07 18:45:49.254630 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 88/189] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:48 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:49.849154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-47415760-4cad-4500-91e7-f6fd855b2b9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:49.850368 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-47415760-4cad-4500-91e7-f6fd855b2b9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:49.861815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47415760-4cad-4500-91e7-f6fd855b2b9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:49.863838 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47415760-4cad-4500-91e7-f6fd855b2b9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:49.864868 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47415760-4cad-4500-91e7-f6fd855b2b9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:49.868129 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47415760-4cad-4500-91e7-f6fd855b2b9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:49.993554 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-47415760-4cad-4500-91e7-f6fd855b2b9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 27072 microversion: 2.1 time: 0.150415 Dec 07 18:45:49.994821 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 89/190] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:49 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 27072 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:50.020516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:50.038479 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-00ff8f01-d929-4b26-a555-ef10f1af521d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 1.173301 Dec 07 18:45:50.042595 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 102/191] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:48 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:50.264890 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:50.266589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:50.285489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:50.286536 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:50.289449 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:50.291880 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:51.004650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8313e472-3bd8-4d87-90fd-b3d2c4371973 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:51.005615 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8313e472-3bd8-4d87-90fd-b3d2c4371973 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:51.013523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8313e472-3bd8-4d87-90fd-b3d2c4371973 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:51.014226 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8313e472-3bd8-4d87-90fd-b3d2c4371973 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:51.015176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8313e472-3bd8-4d87-90fd-b3d2c4371973 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:51.015766 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8313e472-3bd8-4d87-90fd-b3d2c4371973 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:51.121734 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8313e472-3bd8-4d87-90fd-b3d2c4371973 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 27573 microversion: 2.1 time: 0.120445 Dec 07 18:45:51.124635 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 103/192] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:50 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 27573 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:45:51.139270 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:51.140342 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:51.140556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:51.157535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-aa441dd2-644a-43b4-a93a-4aab66b0d41b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.897396 Dec 07 18:45:51.158861 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 90/193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:50 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:51.159306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:51.159780 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:51.162310 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:51.162915 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:51.496685 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:51.508962 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9dce062a-33a8-4d7b-b63a-e341ea5ef901 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 0.379378 Dec 07 18:45:51.513635 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 104/194] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:51 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:52.136691 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-db34092a-d5b7-4ca5-b465-6251a427cfaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:52.137677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-db34092a-d5b7-4ca5-b465-6251a427cfaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:52.152756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-db34092a-d5b7-4ca5-b465-6251a427cfaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:52.154831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-db34092a-d5b7-4ca5-b465-6251a427cfaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:52.156065 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-db34092a-d5b7-4ca5-b465-6251a427cfaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:52.156655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-db34092a-d5b7-4ca5-b465-6251a427cfaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:52.177999 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:52.179284 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:52.187786 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:52.188593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:52.189788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:52.190615 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:52.305054 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-db34092a-d5b7-4ca5-b465-6251a427cfaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 27933 microversion: 2.1 time: 0.172026 Dec 07 18:45:52.306947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 91/195] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:52 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 27933 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:52.542531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:52.543504 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:52.570711 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:52.575251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:52.584098 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:52.586209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:53.081633 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:53.091112 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-acd42e81-ec81-4fc0-b290-d6d97a43dc14 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 0.563934 Dec 07 18:45:53.093868 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 92/196] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:52 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:53.203124 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:53.211276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-23318714-b477-436e-8463-652f5e408601 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 1.041258 Dec 07 18:45:53.211890 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 105/197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:52 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:53.321320 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-af83c9a1-4a39-4cc1-a31f-9d11a14ab0a1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:53.322487 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-af83c9a1-4a39-4cc1-a31f-9d11a14ab0a1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:53.332596 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af83c9a1-4a39-4cc1-a31f-9d11a14ab0a1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:53.333757 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af83c9a1-4a39-4cc1-a31f-9d11a14ab0a1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:53.336139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af83c9a1-4a39-4cc1-a31f-9d11a14ab0a1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:53.336949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af83c9a1-4a39-4cc1-a31f-9d11a14ab0a1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:53.467566 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-af83c9a1-4a39-4cc1-a31f-9d11a14ab0a1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28186 microversion: 2.1 time: 0.151796 Dec 07 18:45:53.471727 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 93/198] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:53 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28186 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:54.111967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:54.112660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:54.124851 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:54.125455 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:54.126436 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:54.127503 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:54.233286 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:54.234028 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:54.244222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:54.248886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:54.250040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:54.250639 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:54.547206 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:54.558738 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7f119bb0-7733-4157-a5b7-6121f1917995 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.333065 Dec 07 18:45:54.572207 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 94/199] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:54 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:54.580461 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d79c82e4-a049-4cbc-a553-f154fe96c5e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:54.583897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d79c82e4-a049-4cbc-a553-f154fe96c5e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:54.597663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d79c82e4-a049-4cbc-a553-f154fe96c5e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:54.598022 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d79c82e4-a049-4cbc-a553-f154fe96c5e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:54.599170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d79c82e4-a049-4cbc-a553-f154fe96c5e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:54.599781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d79c82e4-a049-4cbc-a553-f154fe96c5e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:54.703895 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:54.715030 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d79c82e4-a049-4cbc-a553-f154fe96c5e2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28186 microversion: 2.1 time: 0.136979 Dec 07 18:45:54.717105 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 95/200] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:54 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28186 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:54.724175 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2bb27210-9206-4f50-a806-817a3909d4d9 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 0.616523 Dec 07 18:45:54.730221 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 106/201] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:54 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:55.112765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-87958aad-fb37-4849-9f60-28597d2d98ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'create', calling method: .version_select at 0x7f199840fa60>, body: {"keypair": {"name": "tempest-keypair-2022890137"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:55.134300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-87958aad-fb37-4849-9f60-28597d2d98ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:45:55.140451 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-87958aad-fb37-4849-9f60-28597d2d98ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for user 70351b4675ab4d3690f6b5565dedd3c4 and project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:45:55.578511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:55.579823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:55.596002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:55.596462 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:55.597252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:55.597698 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:55.641645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-87958aad-fb37-4849-9f60-28597d2d98ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:45:55.656673 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-87958aad-fb37-4849-9f60-28597d2d98ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for user 70351b4675ab4d3690f6b5565dedd3c4 and project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:45:55.689270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-87958aad-fb37-4849-9f60-28597d2d98ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.970897 Dec 07 18:45:55.696197 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 96/202] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Dec 7 18:45:54 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 978 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 07 18:45:55.727551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d58803e5-fa90-4f3b-9447-7c11da6c2bb9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:55.728583 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d58803e5-fa90-4f3b-9447-7c11da6c2bb9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:55.739136 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d58803e5-fa90-4f3b-9447-7c11da6c2bb9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:55.742797 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d58803e5-fa90-4f3b-9447-7c11da6c2bb9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:55.744344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d58803e5-fa90-4f3b-9447-7c11da6c2bb9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:55.746058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d58803e5-fa90-4f3b-9447-7c11da6c2bb9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:55.884960 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d58803e5-fa90-4f3b-9447-7c11da6c2bb9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28310 microversion: 2.1 time: 0.161129 Dec 07 18:45:55.885735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 97/203] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:55 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28310 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:55.894770 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:55.912445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:55.941308 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:55.942111 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:55.943142 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:55.944618 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:56.102631 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:56.119775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4b82bc6e-b192-4a8c-85a3-f8a9294d1c4b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.545051 Dec 07 18:45:56.130212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 107/204] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:55 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:56.217860 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:56.226408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1f0bb3af-c9f0-4f88-8f54-c7aaa8c8b68e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 0.335626 Dec 07 18:45:56.230325 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 98/205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:55 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:56.925448 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-62d59d98-3210-42a1-85e7-76026aca5620 req-6c0fc3ad-9522-4762-ac34-d3eca840a795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd63ffe-4565-42f6-8f7c-9f83cda248e8", "name": "network-vif-plugged", "status": "completed", "tag": "1b17425e-406c-49a0-9e23-08dbf104898d"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:56.941631 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4acec479-c817-4fc2-972d-3ee3bebdd6c1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:56.945408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4acec479-c817-4fc2-972d-3ee3bebdd6c1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:56.945687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:45:56.945687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:45:56.967884 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-62d59d98-3210-42a1-85e7-76026aca5620 req-6c0fc3ad-9522-4762-ac34-d3eca840a795 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:56.968829 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4acec479-c817-4fc2-972d-3ee3bebdd6c1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:56.970888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4acec479-c817-4fc2-972d-3ee3bebdd6c1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:56.972277 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-62d59d98-3210-42a1-85e7-76026aca5620 req-6c0fc3ad-9522-4762-ac34-d3eca840a795 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:56.973016 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4acec479-c817-4fc2-972d-3ee3bebdd6c1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:56.974399 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4acec479-c817-4fc2-972d-3ee3bebdd6c1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:57.013017 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-62d59d98-3210-42a1-85e7-76026aca5620 req-6c0fc3ad-9522-4762-ac34-d3eca840a795 service nova] Creating event network-vif-plugged:1b17425e-406c-49a0-9e23-08dbf104898d for instance 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 on hv-cinder-81969 Dec 07 18:45:57.038002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-62d59d98-3210-42a1-85e7-76026aca5620 req-6c0fc3ad-9522-4762-ac34-d3eca840a795 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130164 Dec 07 18:45:57.041218 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 108/206] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:45:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:45:57.142914 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:57.143936 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:57.152650 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4acec479-c817-4fc2-972d-3ee3bebdd6c1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28476 microversion: 2.1 time: 0.245142 Dec 07 18:45:57.153554 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 99/207] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:56 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:57.179386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:57.182237 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:57.187413 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:57.188493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:57.249711 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:57.250744 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:57.287856 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:57.288887 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:57.294397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:57.294397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:57.736722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:57.750411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-333b1b55-13b0-4aef-a40b-c892789b7537 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.616359 Dec 07 18:45:57.756655 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 109/208] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:57 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:57.823237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:57.858891 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-56541e3f-7f5d-4e96-bd9e-8e74e95c6a0c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 0.612396 Dec 07 18:45:57.859592 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 100/209] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:57 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:58.175909 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-84687bd9-d7f8-487e-b48c-23e000e88798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:58.177828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-84687bd9-d7f8-487e-b48c-23e000e88798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:58.185213 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-84687bd9-d7f8-487e-b48c-23e000e88798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:58.186011 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-84687bd9-d7f8-487e-b48c-23e000e88798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:58.187613 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-84687bd9-d7f8-487e-b48c-23e000e88798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:58.190520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-84687bd9-d7f8-487e-b48c-23e000e88798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:58.315103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-84687bd9-d7f8-487e-b48c-23e000e88798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28602 microversion: 2.1 time: 0.154054 Dec 07 18:45:58.320506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 110/210] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:58 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:58.371295 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1137318363", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d18908e-4fa9-4515-9ad2-63e91916c83c"}], "security_groups": [{"name": "tempest-securitygroup--1113104602"}], "key_name": "tempest-keypair-2022890137", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:58.596439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] validate_networks() for [('9d18908e-4fa9-4515-9ad2-63e91916c83c', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:45:58.773861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:58.774856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:58.784755 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:58.785394 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:58.786805 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:58.788056 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:59.315997 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:59.327085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d3889507-38f7-4843-a159-5849bb4ea233 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.558082 Dec 07 18:45:59.333802 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 111/211] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:58 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:45:59.341897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:59.343365 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:59.351587 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:59.352475 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:59.353461 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:59.353897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:59.561483 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:45:59.562893 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:45:59.563494 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:45:59.564004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:45:59.564539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:45:59.576229 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:59.577187 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:59.578400 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:59.579705 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:59.611059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:45:59.615210 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for user 70351b4675ab4d3690f6b5565dedd3c4 and project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:45:59.635163 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:45:59.637771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:45:59.694366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e24f9e2e-9d61-4f0e-a032-7b9b6910fd17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.332142 Dec 07 18:45:59.695704 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 101/212] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Dec 7 18:45:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 07 18:45:59.700572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8b7ce295-c6bd-4a57-8b3c-75490492edf7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:45:59.702082 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8b7ce295-c6bd-4a57-8b3c-75490492edf7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:59.708549 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8b7ce295-c6bd-4a57-8b3c-75490492edf7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:59.709307 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8b7ce295-c6bd-4a57-8b3c-75490492edf7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:59.712113 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8b7ce295-c6bd-4a57-8b3c-75490492edf7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:45:59.713270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8b7ce295-c6bd-4a57-8b3c-75490492edf7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:45:59.746481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:59.755285 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a5fd6542-8d00-4724-8418-4d048d7f3d33 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1318 microversion: 2.1 time: 0.419908 Dec 07 18:45:59.759957 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 112/213] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:45:59 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:45:59.767352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5a14c2bb-1cc3-4448-9a38-9dc069eb56d0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:45:59.770405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5a14c2bb-1cc3-4448-9a38-9dc069eb56d0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:45:59.820436 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8b7ce295-c6bd-4a57-8b3c-75490492edf7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28643 microversion: 2.1 time: 0.120352 Dec 07 18:45:59.821492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 102/214] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:45:59 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28643 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:45:59.876115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5a14c2bb-1cc3-4448-9a38-9dc069eb56d0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:59.892658 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5a14c2bb-1cc3-4448-9a38-9dc069eb56d0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:59.895365 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5a14c2bb-1cc3-4448-9a38-9dc069eb56d0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:45:59.896654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5a14c2bb-1cc3-4448-9a38-9dc069eb56d0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1282 microversion: 2.20 time: 0.135342 Dec 07 18:45:59.898280 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 113/215] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:45:59 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:00.354684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:00.355520 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:00.363704 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.364257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:00.365352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.366711 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:00.581528 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:00.598749 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c364b879-92f3-4e02-9b6a-bd85729c01a8 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.252229 Dec 07 18:46:00.608686 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 103/216] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:00 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:00.778543 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:00.780219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:00.802511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.803759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:00.806278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.808487 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:00.832035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-91618d56-e409-45f3-bcbf-22954bf7ad5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:00.833233 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-91618d56-e409-45f3-bcbf-22954bf7ad5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:00.841527 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-91618d56-e409-45f3-bcbf-22954bf7ad5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.842264 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-91618d56-e409-45f3-bcbf-22954bf7ad5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:00.843261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-91618d56-e409-45f3-bcbf-22954bf7ad5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.843929 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-91618d56-e409-45f3-bcbf-22954bf7ad5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:00.932318 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-91618d56-e409-45f3-bcbf-22954bf7ad5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28643 microversion: 2.1 time: 0.103879 Dec 07 18:46:00.933004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 104/217] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:00 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28643 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:46:00.942724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:00.943361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:00.952584 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.953034 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:00.954224 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:00.954849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:01.041343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:01.051793 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:01.054709 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:01.057610 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-827b25d4-68eb-4dc0-be91-42c7c0f5ad89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1334 microversion: 2.20 time: 0.123103 Dec 07 18:46:01.058469 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 105/218] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:00 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:01.111596 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:01.125709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9e6ba442-5575-4f01-9a7b-f349bff23bbf tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1509 microversion: 2.1 time: 0.354010 Dec 07 18:46:01.127439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 114/219] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:00 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:01.618973 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:01.620141 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:01.633375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:01.634122 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:01.635277 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:01.635973 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:01.901679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:01.910725 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-821e8247-f35b-40c7-aee3-36fcd7971e97 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.296727 Dec 07 18:46:01.912589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 106/220] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:01 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:01.946375 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-399e67bd-7c02-460c-be39-7abc298f6015 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:01.949191 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-399e67bd-7c02-460c-be39-7abc298f6015 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:01.963355 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-399e67bd-7c02-460c-be39-7abc298f6015 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:01.964272 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-399e67bd-7c02-460c-be39-7abc298f6015 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:01.965251 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-399e67bd-7c02-460c-be39-7abc298f6015 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:01.967124 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-399e67bd-7c02-460c-be39-7abc298f6015 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:02.059736 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-399e67bd-7c02-460c-be39-7abc298f6015 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28643 microversion: 2.1 time: 0.118821 Dec 07 18:46:02.064361 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 115/221] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:01 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28643 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:02.079003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:02.080159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:02.089105 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:02.089980 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:02.091287 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:02.092121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:02.172164 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:02.182245 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:02.186911 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:02.188556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8a691f6d-4a5c-4d87-bcf8-40d19af6f6c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1340 microversion: 2.20 time: 0.115904 Dec 07 18:46:02.191148 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 107/222] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:02 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1340 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:02.529790 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-39b33878-1f87-49cb-a090-06c53b71932e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "124f9cb0-9acb-4059-8d68-74cecfb6e0a6"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:02.531013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-39b33878-1f87-49cb-a090-06c53b71932e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:02.540992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39b33878-1f87-49cb-a090-06c53b71932e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:02.541453 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39b33878-1f87-49cb-a090-06c53b71932e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:02.542337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39b33878-1f87-49cb-a090-06c53b71932e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:02.543168 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39b33878-1f87-49cb-a090-06c53b71932e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:02.929221 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:02.929835 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:02.940188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:02.940843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:02.945932 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:02.946394 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:03.028897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-39b33878-1f87-49cb-a090-06c53b71932e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505090 Dec 07 18:46:03.041192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 116/223] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:46:02 2021] POST /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments => generated 194 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:03.072950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dee16fcb-fbf5-4fa4-9571-c0acf2fb2922 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:03.075082 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dee16fcb-fbf5-4fa4-9571-c0acf2fb2922 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:03.091434 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dee16fcb-fbf5-4fa4-9571-c0acf2fb2922 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:03.093316 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dee16fcb-fbf5-4fa4-9571-c0acf2fb2922 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:03.096242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dee16fcb-fbf5-4fa4-9571-c0acf2fb2922 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:03.097010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dee16fcb-fbf5-4fa4-9571-c0acf2fb2922 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:03.208092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dee16fcb-fbf5-4fa4-9571-c0acf2fb2922 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28643 microversion: 2.1 time: 0.138754 Dec 07 18:46:03.210183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 117/224] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:03 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28643 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:03.218461 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:03.219172 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:03.241744 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:03.242242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:03.245138 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:03.245591 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:03.566034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:03.577254 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:03.578835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:03.580106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e324fd39-5705-4abb-9af6-4a850c36fbd2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.368278 Dec 07 18:46:03.580999 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 118/225] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:03 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:03.594666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:03.605952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9e0f38e1-dd21-4fe4-8f96-f72b61bedbc7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.681681 Dec 07 18:46:03.606834 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 108/226] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:02 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:03.795025 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-02f49f3c-9cee-44ea-915b-3f1c2e237d64 req-e4939c6a-d111-4609-bfee-4dbc7b0376e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54d910a-30a1-4aa9-a038-6dafd95bfa5c", "tag": "5d954230-64a1-4c4f-91f6-8893ea16dc4a"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:03.797157 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:03.797157 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:03.812909 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-02f49f3c-9cee-44ea-915b-3f1c2e237d64 req-e4939c6a-d111-4609-bfee-4dbc7b0376e9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:03.813628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-02f49f3c-9cee-44ea-915b-3f1c2e237d64 req-e4939c6a-d111-4609-bfee-4dbc7b0376e9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:03.842656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-02f49f3c-9cee-44ea-915b-3f1c2e237d64 req-e4939c6a-d111-4609-bfee-4dbc7b0376e9 service nova] Creating event network-changed:5d954230-64a1-4c4f-91f6-8893ea16dc4a for instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c on hv-cinder-81969 Dec 07 18:46:03.860457 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-02f49f3c-9cee-44ea-915b-3f1c2e237d64 req-e4939c6a-d111-4609-bfee-4dbc7b0376e9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068516 Dec 07 18:46:03.861623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 119/227] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:04.220827 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ddc062bd-e259-438e-b4e2-d6c3d8232798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:04.221670 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ddc062bd-e259-438e-b4e2-d6c3d8232798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:04.231583 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ddc062bd-e259-438e-b4e2-d6c3d8232798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:04.232030 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ddc062bd-e259-438e-b4e2-d6c3d8232798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:04.232816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ddc062bd-e259-438e-b4e2-d6c3d8232798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:04.233246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ddc062bd-e259-438e-b4e2-d6c3d8232798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:04.310798 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ddc062bd-e259-438e-b4e2-d6c3d8232798 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28643 microversion: 2.1 time: 0.091634 Dec 07 18:46:04.312172 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 109/228] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:04 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28643 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:04.599800 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:04.601234 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:04.608372 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:04.608810 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:04.609588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:04.610039 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:04.624818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:04.625502 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:04.632950 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:04.633426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:04.634454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:04.634890 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:04.768043 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:04.777714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:04.779487 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:04.780836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-aeeabc6b-9bd8-4d5e-9a3f-aef86f0e82ca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.185791 Dec 07 18:46:04.781407 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 120/229] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:04 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:04.853724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:04.861942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-097011e2-19bc-476e-9ece-5dbb252d033d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.241039 Dec 07 18:46:04.862858 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 110/230] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:04 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:05.323728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-17757126-5efc-445b-a300-9134d1431b31 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:05.324657 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-17757126-5efc-445b-a300-9134d1431b31 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:05.331070 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-17757126-5efc-445b-a300-9134d1431b31 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:05.331409 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-17757126-5efc-445b-a300-9134d1431b31 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:05.332175 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-17757126-5efc-445b-a300-9134d1431b31 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:05.332612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-17757126-5efc-445b-a300-9134d1431b31 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:05.404476 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-17757126-5efc-445b-a300-9134d1431b31 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 28643 microversion: 2.1 time: 0.084573 Dec 07 18:46:05.405139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 121/231] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:05 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 28643 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:05.800294 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:05.800896 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:05.807953 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:05.808454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:05.809324 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:05.809761 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:05.880976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:05.881724 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:05.888522 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:05.888964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:05.889759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:05.890262 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:05.946101 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:05.955261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:05.957103 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:05.958268 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cb54bc4a-76c7-4f35-b544-080d3ddab3df tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.161768 Dec 07 18:46:05.958831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 111/232] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:05 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:06.037381 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:06.044678 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0e87a496-2b96-45b2-837b-af5d9d8d83c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.167769 Dec 07 18:46:06.045252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 122/233] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:05 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:06.416361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-78a39b5f-7970-45ea-8232-d5af76d70985 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:06.417307 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-78a39b5f-7970-45ea-8232-d5af76d70985 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:06.423890 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78a39b5f-7970-45ea-8232-d5af76d70985 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:06.424434 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78a39b5f-7970-45ea-8232-d5af76d70985 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:06.425270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78a39b5f-7970-45ea-8232-d5af76d70985 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:06.425749 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78a39b5f-7970-45ea-8232-d5af76d70985 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:06.528837 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-78a39b5f-7970-45ea-8232-d5af76d70985 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 29323 microversion: 2.1 time: 0.115998 Dec 07 18:46:06.529416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 112/234] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:06 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 29323 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:06.976023 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:06.976643 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:06.983766 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:06.984206 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:06.984975 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:06.985405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:07.062866 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:07.064257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:07.073967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:07.074405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:07.075246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:07.075632 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:07.132339 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:07.140858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:07.142395 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:07.143489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-22726b76-6afb-49f2-936b-bcd1684563fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.171167 Dec 07 18:46:07.144054 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 123/235] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:06 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:07.220786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:07.228803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-509b7136-1e06-45c1-901e-fb284ec8f75a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.170286 Dec 07 18:46:07.229360 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 113/236] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:07 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:07.541091 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-902fce58-b146-43c9-aa3c-7459cfb7ddc0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:07.542278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-902fce58-b146-43c9-aa3c-7459cfb7ddc0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:07.549000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-902fce58-b146-43c9-aa3c-7459cfb7ddc0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:07.549537 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-902fce58-b146-43c9-aa3c-7459cfb7ddc0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:07.550406 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-902fce58-b146-43c9-aa3c-7459cfb7ddc0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:07.550893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-902fce58-b146-43c9-aa3c-7459cfb7ddc0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:07.642659 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-902fce58-b146-43c9-aa3c-7459cfb7ddc0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 30527 microversion: 2.1 time: 0.105586 Dec 07 18:46:07.643749 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 124/237] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:07 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 30527 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:46:08.163031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:08.163916 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:08.178576 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:08.179024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:08.179811 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:08.180341 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:08.246286 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:08.246909 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:08.254936 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:08.255645 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:08.256476 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:08.256912 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:08.329213 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:08.339237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:08.341318 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:08.341863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-73850a72-8773-442a-aca9-c877dc365c3a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.182828 Dec 07 18:46:08.346670 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 114/238] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:08 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:08.397062 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:08.404710 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-eaa6faf2-5b79-46f8-8ffa-f4ce19b2f33b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.162753 Dec 07 18:46:08.405282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 125/239] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:08 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:08.655879 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4a0dbcd1-f179-4836-a236-d1130772d859 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:08.656876 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4a0dbcd1-f179-4836-a236-d1130772d859 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:08.663114 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a0dbcd1-f179-4836-a236-d1130772d859 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:08.663443 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a0dbcd1-f179-4836-a236-d1130772d859 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:08.664153 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a0dbcd1-f179-4836-a236-d1130772d859 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:08.664586 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a0dbcd1-f179-4836-a236-d1130772d859 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:08.758367 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4a0dbcd1-f179-4836-a236-d1130772d859 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 31721 microversion: 2.1 time: 0.106230 Dec 07 18:46:08.759465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 115/240] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:08 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 31721 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:46:09.371197 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:09.371697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:09.379944 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:09.380401 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:09.381211 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:09.381927 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:09.440810 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:09.441748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:09.460645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:09.462695 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:09.471314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:09.474208 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:09.594404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:09.607686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:09.609566 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:09.610860 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8c3198d6-0129-4ae1-a5b8-1a1ce20b9de9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.251000 Dec 07 18:46:09.611626 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 126/241] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:09 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:09.659447 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:09.669084 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-067c8682-2e60-4c0b-946a-727d58dfd92a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.249938 Dec 07 18:46:09.669660 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 116/242] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:09 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:09.770941 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-632e4523-44bb-4f6c-93bc-3db214fbad64 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:09.771970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-632e4523-44bb-4f6c-93bc-3db214fbad64 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:09.780262 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-632e4523-44bb-4f6c-93bc-3db214fbad64 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:09.781723 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-632e4523-44bb-4f6c-93bc-3db214fbad64 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:09.782593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-632e4523-44bb-4f6c-93bc-3db214fbad64 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:09.783061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-632e4523-44bb-4f6c-93bc-3db214fbad64 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:09.864317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-632e4523-44bb-4f6c-93bc-3db214fbad64 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 32739 microversion: 2.1 time: 0.097011 Dec 07 18:46:09.865076 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 127/243] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:09 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 32739 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:10.591179 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "124f9cb0-9acb-4059-8d68-74cecfb6e0a6"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:10.592230 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:10.598373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.598821 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.599590 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.600143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.633253 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:10.634901 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:10.642235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.643635 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.644567 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.645210 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.693591 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] HTTP exception thrown: Invalid volume: volume 124f9cb0-9acb-4059-8d68-74cecfb6e0a6 is already attached to instances: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 Dec 07 18:46:10.697754 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Returning 400 to user: Invalid volume: volume 124f9cb0-9acb-4059-8d68-74cecfb6e0a6 is already attached to instances: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:46:10.698806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2c8ab0d8-31c5-4dac-b329-a50512a3fd5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112024 Dec 07 18:46:10.699833 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 117/244] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:46:10 2021] POST /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 07 18:46:10.710134 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:10.710933 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:10.720557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.726090 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.727401 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.729421 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.922443 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:10.931202 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-337c2a27-0650-4ba4-9cfe-511500b1345f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.226228 Dec 07 18:46:10.937714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:10.943180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 118/245] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:10 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:10.947601 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:10.949730 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:10.950363 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:10.950706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:10.951699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cacb417b-b43a-4e5c-b3e6-4ce76b4ec334 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.325382 Dec 07 18:46:10.962518 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.963351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 128/246] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:10 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:10.963998 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.964967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.965696 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.969442 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-db75264b-1c68-4411-9d6a-e038880dd875 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:10.970648 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-db75264b-1c68-4411-9d6a-e038880dd875 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:10.976700 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db75264b-1c68-4411-9d6a-e038880dd875 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.977386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db75264b-1c68-4411-9d6a-e038880dd875 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:10.979042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db75264b-1c68-4411-9d6a-e038880dd875 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:10.979689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db75264b-1c68-4411-9d6a-e038880dd875 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:11.086439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-db75264b-1c68-4411-9d6a-e038880dd875 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 33329 microversion: 2.1 time: 0.121022 Dec 07 18:46:11.087375 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 129/247] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:10 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 33329 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:11.168417 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lazy-loading 'services' on Instance uuid 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:46:11.494091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5fcefd27-b683-44f4-ae0d-f2bdf68a7de3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments/124f9cb0-9acb-4059-8d68-74cecfb6e0a6" status: 202 len: 0 microversion: 2.1 time: 0.548694 Dec 07 18:46:11.495067 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 119/248] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:46:10 2021] DELETE /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments/124f9cb0-9acb-4059-8d68-74cecfb6e0a6 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:11.504133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a40c0eb1-1b90-43d6-b983-fd5ddcc31ade tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:11.505139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a40c0eb1-1b90-43d6-b983-fd5ddcc31ade tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:11.512641 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a40c0eb1-1b90-43d6-b983-fd5ddcc31ade tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:11.513377 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a40c0eb1-1b90-43d6-b983-fd5ddcc31ade tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:11.514385 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a40c0eb1-1b90-43d6-b983-fd5ddcc31ade tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:11.514994 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a40c0eb1-1b90-43d6-b983-fd5ddcc31ade tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:11.549208 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a40c0eb1-1b90-43d6-b983-fd5ddcc31ade tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049505 Dec 07 18:46:11.549797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 130/249] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:46:11 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:11.950737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:11.952078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:11.961360 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:11.961808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:11.963158 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:11.965115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:11.970180 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:11.970773 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:11.977156 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:11.977701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:11.978509 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:11.978936 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:12.144937 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:12.161123 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:12.162679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:12.164532 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:12.166893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-11b421a3-576b-4532-b918-6e0a0ab3fb77 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.199477 Dec 07 18:46:12.171668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b5774999-fab7-4455-a98c-5b8a4387e8f3 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.225039 Dec 07 18:46:12.172425 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 120/250] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:11 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:12.179897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 131/251] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:11 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:46:12.190329 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e975a18a-d9db-4ed2-b165-f93c83550146 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:12.191721 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e975a18a-d9db-4ed2-b165-f93c83550146 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:12.213726 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e975a18a-d9db-4ed2-b165-f93c83550146 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:12.214426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e975a18a-d9db-4ed2-b165-f93c83550146 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:12.215425 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e975a18a-d9db-4ed2-b165-f93c83550146 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:12.216044 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e975a18a-d9db-4ed2-b165-f93c83550146 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:12.299862 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e975a18a-d9db-4ed2-b165-f93c83550146 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 33809 microversion: 2.1 time: 0.126048 Dec 07 18:46:12.304218 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 121/252] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:12 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 33809 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:12.562837 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fed12bc1-708c-4b35-aef5-3355c8e39f7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:12.563815 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fed12bc1-708c-4b35-aef5-3355c8e39f7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:12.570518 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed12bc1-708c-4b35-aef5-3355c8e39f7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:12.571190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed12bc1-708c-4b35-aef5-3355c8e39f7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:12.572432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed12bc1-708c-4b35-aef5-3355c8e39f7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:12.573040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed12bc1-708c-4b35-aef5-3355c8e39f7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:12.607998 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fed12bc1-708c-4b35-aef5-3355c8e39f7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049033 Dec 07 18:46:12.609221 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 132/253] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:46:12 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:46:12.787211 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2130695342", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "c8b8ce23-5289-4bad-a75a-485ea880ca99"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:13.184932 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:13.185487 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:13.193808 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:13.194557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:13.195594 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:13.196120 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:13.343628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:13.354308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:13.356371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:13.357562 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-13ac6710-85c3-4565-8269-5f30b787e575 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.176901 Dec 07 18:46:13.369443 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 133/254] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:13 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:13.375091 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:13.376136 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:13.382623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:13.383401 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:13.385047 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:13.385812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:13.649992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:13.672908 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dd63969c-c587-46d1-bbe7-3408030ebe6b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.301915 Dec 07 18:46:13.673783 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 134/255] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:13 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:13.685861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d13e6061-d2ea-461e-9f2b-debdff20f7f5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:13.687089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d13e6061-d2ea-461e-9f2b-debdff20f7f5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:13.704458 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d13e6061-d2ea-461e-9f2b-debdff20f7f5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:13.705022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d13e6061-d2ea-461e-9f2b-debdff20f7f5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:13.705823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d13e6061-d2ea-461e-9f2b-debdff20f7f5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:13.706276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d13e6061-d2ea-461e-9f2b-debdff20f7f5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:13.784934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d13e6061-d2ea-461e-9f2b-debdff20f7f5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 35057 microversion: 2.1 time: 0.109899 Dec 07 18:46:13.790673 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 135/256] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:13 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 35057 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:14.375998 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:14.377470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:14.388420 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:14.389018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:14.389950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:14.390841 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:14.573176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:14.587217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:14.588913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:14.590226 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d6139140-4617-4d07-a673-5f69896bdda4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.218541 Dec 07 18:46:14.591148 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 136/257] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:14 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:46:14.693256 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:14.694226 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:14.700439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:14.700883 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:14.701999 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:14.701999 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:14.865833 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:14.875090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-caf02e56-6a41-41e6-bd5e-4babe124dda1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.185867 Dec 07 18:46:14.875667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 137/258] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:14 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:14.881508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-de200e87-99fc-49b2-98fa-744423b32017 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:14.882449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-de200e87-99fc-49b2-98fa-744423b32017 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:14.891692 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de200e87-99fc-49b2-98fa-744423b32017 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:14.892417 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de200e87-99fc-49b2-98fa-744423b32017 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:14.893573 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de200e87-99fc-49b2-98fa-744423b32017 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:14.894221 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de200e87-99fc-49b2-98fa-744423b32017 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:14.989631 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-de200e87-99fc-49b2-98fa-744423b32017 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 35992 microversion: 2.1 time: 0.112749 Dec 07 18:46:14.990822 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 138/259] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:14 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 35992 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:15.610069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:15.611675 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:15.620065 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:15.620844 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:15.622020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:15.622669 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:15.784619 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:15.793110 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:15.794745 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:15.795950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9f6c9b15-1aa0-4aef-afcb-34a37dce9328 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.191200 Dec 07 18:46:15.810199 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 139/260] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:15 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:15.891756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:15.892412 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:15.901223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:15.901665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:15.902897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:15.903475 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:16.130566 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:16.140984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9cdffd33-5bbe-4cfe-bc5d-e0e641eeaf80 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.252761 Dec 07 18:46:16.150928 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 140/261] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:15 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:16.150928 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a5fd8c56-41d7-4c4e-93c2-549b7cfb1857 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:16.150928 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a5fd8c56-41d7-4c4e-93c2-549b7cfb1857 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:16.157421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd8c56-41d7-4c4e-93c2-549b7cfb1857 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:16.157880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd8c56-41d7-4c4e-93c2-549b7cfb1857 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:16.158701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd8c56-41d7-4c4e-93c2-549b7cfb1857 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:16.159142 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5fd8c56-41d7-4c4e-93c2-549b7cfb1857 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:16.269536 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a5fd8c56-41d7-4c4e-93c2-549b7cfb1857 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 37205 microversion: 2.1 time: 0.125865 Dec 07 18:46:16.273839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 141/262] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:16 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 37205 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:16.363815 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-3a0a5383-e4f1-4641-bd94-d359c14f7e98 req-6fdc7419-a83d-48e4-9805-44571bbed450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54d910a-30a1-4aa9-a038-6dafd95bfa5c", "name": "network-vif-plugged", "status": "completed", "tag": "5d954230-64a1-4c4f-91f6-8893ea16dc4a"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:16.366059 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:16.366059 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:16.391818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-3a0a5383-e4f1-4641-bd94-d359c14f7e98 req-6fdc7419-a83d-48e4-9805-44571bbed450 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:16.392277 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-3a0a5383-e4f1-4641-bd94-d359c14f7e98 req-6fdc7419-a83d-48e4-9805-44571bbed450 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:16.407095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-3a0a5383-e4f1-4641-bd94-d359c14f7e98 req-6fdc7419-a83d-48e4-9805-44571bbed450 service nova] Creating event network-vif-plugged:5d954230-64a1-4c4f-91f6-8893ea16dc4a for instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c on hv-cinder-81969 Dec 07 18:46:16.426243 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-3a0a5383-e4f1-4641-bd94-d359c14f7e98 req-6fdc7419-a83d-48e4-9805-44571bbed450 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053366 Dec 07 18:46:16.426243 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 142/263] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:16.816806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:16.817544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:16.824857 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:16.825468 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:16.830134 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:16.830134 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:16.917357 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] validate_networks() for [('c8b8ce23-5289-4bad-a75a-485ea880ca99', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:46:17.014452 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:17.027141 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:17.028649 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:17.029770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-498de064-966f-4b8b-b3ed-c27cc84258e0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.218506 Dec 07 18:46:17.041060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 143/264] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:16 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:17.158343 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:17.159214 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:17.169080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:17.171709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:17.172731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:17.173615 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:17.348883 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:17.357133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c11a7174-496e-4219-ae5b-0d90734d7db5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.202541 Dec 07 18:46:17.358115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 144/265] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:17 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:17.362925 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-69afe2ea-b23d-476d-b1b6-00a47a68c8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:17.363832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-69afe2ea-b23d-476d-b1b6-00a47a68c8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:17.370136 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69afe2ea-b23d-476d-b1b6-00a47a68c8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:17.370395 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69afe2ea-b23d-476d-b1b6-00a47a68c8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:17.371194 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69afe2ea-b23d-476d-b1b6-00a47a68c8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:17.371635 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69afe2ea-b23d-476d-b1b6-00a47a68c8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:17.421814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:46:17.422284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:46:17.422760 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:46:17.423434 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:46:17.423861 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:46:17.440103 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:17.440557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:17.441372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:17.441806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:17.468804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:46:17.473407 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-69afe2ea-b23d-476d-b1b6-00a47a68c8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 38025 microversion: 2.1 time: 0.113911 Dec 07 18:46:17.474697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 145/266] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:17 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 38025 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:17.475579 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Getting quotas for user be5301c42eaa4538800ccab20dfc9b7c and project 12e59e340c3845b199cb2b187d625932. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:46:17.487686 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:46:17.490277 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:46:17.540314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6e4cb302-b63c-4972-abf6-23022817a524 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.757574 Dec 07 18:46:17.541309 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 122/267] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:46:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 4760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:46:17.557533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ce57a1e5-e2aa-4100-a6e3-e9a913f50951 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:17.558950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ce57a1e5-e2aa-4100-a6e3-e9a913f50951 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:17.630577 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ce57a1e5-e2aa-4100-a6e3-e9a913f50951 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:17.641224 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ce57a1e5-e2aa-4100-a6e3-e9a913f50951 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1218 microversion: 2.1 time: 0.093986 Dec 07 18:46:17.642037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 146/268] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:17 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:18.048284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:18.048888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:18.062858 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.063500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.064364 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.064910 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.227975 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:18.237041 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:18.239016 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:18.240399 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b2e507b9-8e22-475b-bc0f-609e956977c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1408 microversion: 2.20 time: 0.195986 Dec 07 18:46:18.250922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 123/269] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:18 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:46:18.376212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:18.377467 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:18.385832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.386580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.387391 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.388012 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.486494 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2b6d5362-af4a-48db-916c-c38b57b93f16 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:18.488295 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2b6d5362-af4a-48db-916c-c38b57b93f16 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:18.499269 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b6d5362-af4a-48db-916c-c38b57b93f16 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.501520 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b6d5362-af4a-48db-916c-c38b57b93f16 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.502602 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b6d5362-af4a-48db-916c-c38b57b93f16 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.506209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b6d5362-af4a-48db-916c-c38b57b93f16 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.540785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:18.548871 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-39ee94d5-6078-46dd-9df3-716231e0e17c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.177851 Dec 07 18:46:18.549876 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 147/270] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:18 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:18.632475 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2b6d5362-af4a-48db-916c-c38b57b93f16 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 38152 microversion: 2.1 time: 0.149756 Dec 07 18:46:18.633972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 124/271] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:18 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 38152 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:18.658895 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:18.659869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:18.667819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.668272 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.669264 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:18.670162 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:18.749171 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:18.759409 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4376a22b-a14c-475e-aaee-f474b735367d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1270 microversion: 2.1 time: 0.104164 Dec 07 18:46:18.760274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 148/272] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:18 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1270 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:19.260990 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:19.261687 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:19.280085 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.280545 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.281354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.281789 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.508392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:19.517826 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:19.533156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:19.536042 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e466c0e8-d6a5-4ca8-adbf-c2abc795bf36 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1600 microversion: 2.20 time: 0.280136 Dec 07 18:46:19.542096 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 125/273] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:46:19 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1600 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:19.565096 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b97e1015-88c2-425a-b747-27ab97e6bdac tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:19.566584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b97e1015-88c2-425a-b747-27ab97e6bdac tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:19.577355 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:19.578659 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:19.585297 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b97e1015-88c2-425a-b747-27ab97e6bdac tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.585754 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b97e1015-88c2-425a-b747-27ab97e6bdac tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.586593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b97e1015-88c2-425a-b747-27ab97e6bdac tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.587439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b97e1015-88c2-425a-b747-27ab97e6bdac tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.591167 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.591703 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.592562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.593201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.746256 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b97e1015-88c2-425a-b747-27ab97e6bdac tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.185224 Dec 07 18:46:19.747386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 149/274] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Dec 7 18:46:19 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:19.756839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cc954806-0845-42bd-b8dc-10d7bee3d001 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:19.759308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cc954806-0845-42bd-b8dc-10d7bee3d001 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:19.768911 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc954806-0845-42bd-b8dc-10d7bee3d001 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.769816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc954806-0845-42bd-b8dc-10d7bee3d001 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.772701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc954806-0845-42bd-b8dc-10d7bee3d001 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.773347 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc954806-0845-42bd-b8dc-10d7bee3d001 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.878078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cc954806-0845-42bd-b8dc-10d7bee3d001 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 38152 microversion: 2.1 time: 0.129410 Dec 07 18:46:19.885402 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 150/275] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:19 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 38152 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:46:19.891154 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:19.892217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:19.900106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.900862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.901891 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:19.902570 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:19.955759 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:19.970972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9a1f03e1-4f0f-45c1-a858-078c9a60eb7c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1523 microversion: 2.1 time: 0.406985 Dec 07 18:46:19.980361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 126/276] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:19 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:20.002416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:20.012405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-726fd587-6793-4348-b015-c695c3c1a410 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1276 microversion: 2.1 time: 0.125284 Dec 07 18:46:20.013958 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 151/277] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:19 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:20.594477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e0f198f7-a724-41ce-a5c1-63958056a376 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Action: 'create', calling method: .version_select at 0x7f1998435790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-772467978"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:20.610627 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-e0f198f7-a724-41ce-a5c1-63958056a376 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Getting quotas for project 60c42061bf6e4acb909fab4c8dbc4c0d. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:46:20.615458 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-e0f198f7-a724-41ce-a5c1-63958056a376 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Getting quotas for user 1520b91805ad483193835c75157a16f7 and project 60c42061bf6e4acb909fab4c8dbc4c0d. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:46:20.748782 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-e0f198f7-a724-41ce-a5c1-63958056a376 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Getting quotas for project 60c42061bf6e4acb909fab4c8dbc4c0d. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:46:20.752888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-e0f198f7-a724-41ce-a5c1-63958056a376 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Getting quotas for user 1520b91805ad483193835c75157a16f7 and project 60c42061bf6e4acb909fab4c8dbc4c0d. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:46:20.765986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e0f198f7-a724-41ce-a5c1-63958056a376 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.175642 Dec 07 18:46:20.767132 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 127/278] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Dec 7 18:46:20 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:20.820656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-44623969", "imageRef": "a75f256f-40cd-4dac-803b-ac87850d5706", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-772467978", "networks": [{"uuid": "231250c2-6b44-47d0-805a-e173a98bb0d4"}]}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:20.883069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] validate_networks() for [('231250c2-6b44-47d0-805a-e173a98bb0d4', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:46:20.892689 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f9e502b5-9ee6-485d-825a-f72c6932697b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:20.893652 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f9e502b5-9ee6-485d-825a-f72c6932697b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:20.902161 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f9e502b5-9ee6-485d-825a-f72c6932697b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:20.902805 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f9e502b5-9ee6-485d-825a-f72c6932697b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:20.903460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f9e502b5-9ee6-485d-825a-f72c6932697b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:20.903944 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f9e502b5-9ee6-485d-825a-f72c6932697b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.020763 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f9e502b5-9ee6-485d-825a-f72c6932697b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 200 len: 38283 microversion: 2.1 time: 0.131707 Dec 07 18:46:21.021961 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 128/279] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:20 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 38283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:46:21.033508 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:21.034243 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:21.041457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.041927 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.042705 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.043134 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.316436 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:21.333233 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5b804a8d-dac0-487c-941d-c821f9a469ec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1503 microversion: 2.1 time: 0.303541 Dec 07 18:46:21.346910 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 129/280] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:21 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1503 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:21.352159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b451ed2d-b10f-4f07-a1c4-7e825c4e5403 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:21.353493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b451ed2d-b10f-4f07-a1c4-7e825c4e5403 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:21.363757 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b451ed2d-b10f-4f07-a1c4-7e825c4e5403 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.366453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b451ed2d-b10f-4f07-a1c4-7e825c4e5403 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.368174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b451ed2d-b10f-4f07-a1c4-7e825c4e5403 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.373883 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b451ed2d-b10f-4f07-a1c4-7e825c4e5403 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.433256 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b451ed2d-b10f-4f07-a1c4-7e825c4e5403 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/ips" status: 200 len: 147 microversion: 2.1 time: 0.084784 Dec 07 18:46:21.444437 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 130/281] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Dec 7 18:46:21 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/ips => generated 147 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:21.456280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:21.456981 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:21.474666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.474666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.474666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.474666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.517949 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:46:21.518710 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:46:21.519368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:46:21.519957 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:46:21.520701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:46:21.533820 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.534359 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.535225 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.535747 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.554282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Getting quotas for project 60c42061bf6e4acb909fab4c8dbc4c0d. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:46:21.559738 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Getting quotas for user 1520b91805ad483193835c75157a16f7 and project 60c42061bf6e4acb909fab4c8dbc4c0d. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:46:21.573132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:46:21.575927 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a75f256f-40cd-4dac-803b-ac87850d5706',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:46:21.651217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c50f0a39-14fb-4b56-8504-46e1031876e8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834079 Dec 07 18:46:21.660238 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 152/282] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:46:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:46:21.665447 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9cf0440e-6ad4-4b47-88c8-6a6704b07686 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:21.666733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9cf0440e-6ad4-4b47-88c8-6a6704b07686 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:21.680161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cf0440e-6ad4-4b47-88c8-6a6704b07686 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.682350 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cf0440e-6ad4-4b47-88c8-6a6704b07686 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.683503 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cf0440e-6ad4-4b47-88c8-6a6704b07686 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.684134 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9cf0440e-6ad4-4b47-88c8-6a6704b07686 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.755562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:21.768622 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-de8dffdf-c28d-4413-975a-7e557bffb0bb tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1318 microversion: 2.1 time: 0.323043 Dec 07 18:46:21.775533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9cf0440e-6ad4-4b47-88c8-6a6704b07686 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 14 microversion: 2.20 time: 0.110920 Dec 07 18:46:21.775994 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 153/283] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:21 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:21.778733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 131/284] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:21 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:21.784848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-5c6c37ab-790f-4f36-8538-a278ec6d5316 req-f3750c31-d00a-45cc-8253-08e14ffd1f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54d910a-30a1-4aa9-a038-6dafd95bfa5c", "tag": "5d954230-64a1-4c4f-91f6-8893ea16dc4a"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:21.786746 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:21.786746 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:46:21.792628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-b0ebfdff-38c8-4057-89bc-f35efc457321 req-ed5ff90a-4d02-4dc4-8040-1137b94ebafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb71bb34-2f82-45de-91ba-98a927600c63", "tag": "74f8e1e0-b8b9-4c09-bd9a-f2532cc37bcf"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:21.796110 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-5c6c37ab-790f-4f36-8538-a278ec6d5316 req-f3750c31-d00a-45cc-8253-08e14ffd1f7c service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.796684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-5c6c37ab-790f-4f36-8538-a278ec6d5316 req-f3750c31-d00a-45cc-8253-08e14ffd1f7c service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.797790 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:21.797790 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:21.816859 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b0ebfdff-38c8-4057-89bc-f35efc457321 req-ed5ff90a-4d02-4dc4-8040-1137b94ebafb service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.818308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b0ebfdff-38c8-4057-89bc-f35efc457321 req-ed5ff90a-4d02-4dc4-8040-1137b94ebafb service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.818434 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-5c6c37ab-790f-4f36-8538-a278ec6d5316 req-f3750c31-d00a-45cc-8253-08e14ffd1f7c service nova] Creating event network-changed:5d954230-64a1-4c4f-91f6-8893ea16dc4a for instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c on hv-cinder-81969 Dec 07 18:46:21.831760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-b0ebfdff-38c8-4057-89bc-f35efc457321 req-ed5ff90a-4d02-4dc4-8040-1137b94ebafb service nova] Creating event network-changed:74f8e1e0-b8b9-4c09-bd9a-f2532cc37bcf for instance fb71bb34-2f82-45de-91ba-98a927600c63 on hv-cinder-81969 Dec 07 18:46:21.837888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-5c6c37ab-790f-4f36-8538-a278ec6d5316 req-f3750c31-d00a-45cc-8253-08e14ffd1f7c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055072 Dec 07 18:46:21.839276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-b0ebfdff-38c8-4057-89bc-f35efc457321 req-ed5ff90a-4d02-4dc4-8040-1137b94ebafb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056939 Dec 07 18:46:21.839404 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 132/285] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:21.840967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 154/286] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:21.844986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:21.845751 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:21.847106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-09f50143-4485-4ad3-a267-9a20cbaab666 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:21.854070 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.854466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.855327 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:21.855839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:21.859222 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-09f50143-4485-4ad3-a267-9a20cbaab666 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:21.922471 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-09f50143-4485-4ad3-a267-9a20cbaab666 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:21.930936 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-09f50143-4485-4ad3-a267-9a20cbaab666 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1256 microversion: 2.1 time: 0.088016 Dec 07 18:46:21.932617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 155/287] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:21 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1256 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:22.152632 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:22.160590 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0fd95605-a5e5-457e-badf-d5804db0c236 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1517 microversion: 2.1 time: 0.319722 Dec 07 18:46:22.161171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 133/288] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:21 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1517 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:22.786654 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:22.787269 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0d67fd2d-0769-4c62-8394-c2fdc8bf042e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:22.787385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:22.787803 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0d67fd2d-0769-4c62-8394-c2fdc8bf042e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:22.794343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:22.794794 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:22.795581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:22.795712 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d67fd2d-0769-4c62-8394-c2fdc8bf042e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:22.796239 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d67fd2d-0769-4c62-8394-c2fdc8bf042e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:22.796558 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:22.797033 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d67fd2d-0769-4c62-8394-c2fdc8bf042e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:22.797519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d67fd2d-0769-4c62-8394-c2fdc8bf042e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:22.894988 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0d67fd2d-0769-4c62-8394-c2fdc8bf042e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 14 microversion: 2.20 time: 0.111967 Dec 07 18:46:22.895613 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 156/289] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:22 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:22.948623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:22.949317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:22.956931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:22.956931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:22.957418 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:22.957853 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:23.032597 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:23.042610 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a9e18a2b-b584-4f45-8dc2-da2ff23c4422 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1308 microversion: 2.1 time: 0.097794 Dec 07 18:46:23.044082 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 157/290] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:22 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:23.064872 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:23.072933 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e3e64f11-148e-44ee-aefd-1ad8096501d7 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1318 microversion: 2.1 time: 0.289718 Dec 07 18:46:23.073547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 134/291] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:22 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:23.478139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:23.479027 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:23.485455 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:23.485970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:23.486942 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:23.488212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:23.514667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lazy-loading 'flavor' on Instance uuid a5651cc9-ef23-4b3a-bfc6-dd832eaec69f {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:46:23.669201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-21bebcca-3d00-4335-a436-af3d387d58f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action" status: 200 len: 32 microversion: 2.1 time: 0.195583 Dec 07 18:46:23.672931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 158/292] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:23 2021] POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:46:23.683137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:23.684293 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:23.695871 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:23.696362 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:23.697202 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:23.697642 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:23.909162 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8c94c4c7-9595-4764-a18e-38aff6d9f5a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:23.910584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8c94c4c7-9595-4764-a18e-38aff6d9f5a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:23.924523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c94c4c7-9595-4764-a18e-38aff6d9f5a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:23.926162 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c94c4c7-9595-4764-a18e-38aff6d9f5a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:23.927821 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c94c4c7-9595-4764-a18e-38aff6d9f5a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:23.928257 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c94c4c7-9595-4764-a18e-38aff6d9f5a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:24.097966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:24.108392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c9913e9a-4823-4295-9516-ff555c758a08 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.430210 Dec 07 18:46:24.116557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 135/293] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:23 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:24.134220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:24.134220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:24.134964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:24.135991 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:24.143863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:24.147178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:24.330219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:24.337842 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e5c7fbf3-37bf-4630-80de-0729f84e26c3 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.220004 Dec 07 18:46:24.338478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 136/294] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:24 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:24.342919 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:24.343700 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:24.349748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:24.350440 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:24.351224 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:24.351668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:24.498039 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:24.505344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-63ddc28e-da54-40dc-966e-157ff4c8cf5c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1318 microversion: 2.1 time: 0.165750 Dec 07 18:46:24.505930 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 137/295] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:24 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:24.510336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-269176220", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1526245359", "security_groups": [{"name": "tempest-secgroup-smoke-1547138161"}], "networks": [{"uuid": "f1cf0dd1-f3a3-47d9-9b26-d9bdfb74a584"}], "block_device_mapping_v2": [{"uuid": "1fe649e6-a32c-4cff-b3fe-000a1c5585d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:24.631471 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] validate_networks() for [('f1cf0dd1-f3a3-47d9-9b26-d9bdfb74a584', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:46:25.096169 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:46:25.096822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:46:25.097342 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:46:25.097754 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:46:25.098187 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:46:25.120797 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:25.121343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:25.122268 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:25.122831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:25.148557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Getting quotas for project 9dbb7c47db4047b7b6b9fdc130ea461d. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:46:25.154811 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Getting quotas for user 7eb48055ae8141bbb31e920aba3f6763 and project 9dbb7c47db4047b7b6b9fdc130ea461d. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:46:25.229548 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:46:25.231828 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1fe649e6-a32c-4cff-b3fe-000a1c5585d4',volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:46:25.361971 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f945b4a8-4160-44dd-a628-3c065491fe96 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.854886 Dec 07 18:46:25.362854 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 138/296] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:46:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:46:25.372053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e2a90445-53c1-40d6-9606-345033b76a94 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1286bd2a-498c-495d-b740-6cabaed81364"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:25.373204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e2a90445-53c1-40d6-9606-345033b76a94 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:25.382931 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2a90445-53c1-40d6-9606-345033b76a94 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:25.384368 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2a90445-53c1-40d6-9606-345033b76a94 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:25.384899 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2a90445-53c1-40d6-9606-345033b76a94 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:25.385363 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2a90445-53c1-40d6-9606-345033b76a94 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:36.777949 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8c94c4c7-9595-4764-a18e-38aff6d9f5a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 14 microversion: 2.20 time: 12.874912 Dec 07 18:46:36.779844 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 159/297] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:23 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 14 bytes in 12878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:36.786354 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:36.790222 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:36.810181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:36.810628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:36.812030 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:36.812030 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.006074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e2a90445-53c1-40d6-9606-345033b76a94 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.641792 Dec 07 18:46:37.006744 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 139/298] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:46:25 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-volume_attachments => generated 194 bytes in 11643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:37.007901 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:37.018741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:37.019455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:37.025220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9ba3aac5-487d-4810-91cd-adfa00eed715 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.243948 Dec 07 18:46:37.026127 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.026575 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.027518 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.027794 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.033164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 160/299] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:36 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:37.042085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:37.042085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:37.049160 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.054963 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.056387 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.057047 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.134784 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:37.146755 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f6c0f915-aab4-4e13-9e4a-192578cf4856 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1186 microversion: 2.1 time: 0.112280 Dec 07 18:46:37.147543 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 161/300] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:37 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1186 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:37.153887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:37.153887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:37.161242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.161688 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.162728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.163524 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.310288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:37.317969 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bb884fb4-d8b2-49ef-903b-24af4fd87fcd tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1318 microversion: 2.1 time: 0.168977 Dec 07 18:46:37.318763 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 162/301] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:37 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:37.323139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-849f6566-76d9-4374-82c4-f3f47bf0026e req-20c41a16-31e2-4235-8c7f-fa0bdbb07ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb71bb34-2f82-45de-91ba-98a927600c63", "name": "network-vif-plugged", "status": "completed", "tag": "74f8e1e0-b8b9-4c09-bd9a-f2532cc37bcf"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:37.324976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:37.324976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:37.332150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-849f6566-76d9-4374-82c4-f3f47bf0026e req-20c41a16-31e2-4235-8c7f-fa0bdbb07ed5 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.332583 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-849f6566-76d9-4374-82c4-f3f47bf0026e req-20c41a16-31e2-4235-8c7f-fa0bdbb07ed5 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.343272 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-849f6566-76d9-4374-82c4-f3f47bf0026e req-20c41a16-31e2-4235-8c7f-fa0bdbb07ed5 service nova] Creating event network-vif-plugged:74f8e1e0-b8b9-4c09-bd9a-f2532cc37bcf for instance fb71bb34-2f82-45de-91ba-98a927600c63 on hv-cinder-81969 Dec 07 18:46:37.349140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-849f6566-76d9-4374-82c4-f3f47bf0026e req-20c41a16-31e2-4235-8c7f-fa0bdbb07ed5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029195 Dec 07 18:46:37.350144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 163/302] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:37.555159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:37.562440 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-dd71cc0f-ca32-45ce-875c-1f1238bb94b2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.549379 Dec 07 18:46:37.565963 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 140/303] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:37 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:37.791858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-69c88d4f-4986-43f4-92fc-1e552dc61f3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:37.792859 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-69c88d4f-4986-43f4-92fc-1e552dc61f3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:37.804301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69c88d4f-4986-43f4-92fc-1e552dc61f3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.804821 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69c88d4f-4986-43f4-92fc-1e552dc61f3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.805856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69c88d4f-4986-43f4-92fc-1e552dc61f3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:37.806438 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69c88d4f-4986-43f4-92fc-1e552dc61f3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:37.891916 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-69c88d4f-4986-43f4-92fc-1e552dc61f3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 6451 microversion: 2.20 time: 0.104720 Dec 07 18:46:37.892984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 164/304] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:37 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 6451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:46:38.053610 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:38.054914 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:38.061499 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.062336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.063840 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.064718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.087498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-c46d3aad-5cfa-4609-a915-e301689dbca1 req-3133c356-8984-49ad-946a-d19880e82f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669946de-d56d-400a-aa4e-0b1c8ab97e46", "tag": "6c4ac575-82d3-4c88-90cb-0083321e1635"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:38.089272 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:38.089272 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:38.107785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-c46d3aad-5cfa-4609-a915-e301689dbca1 req-3133c356-8984-49ad-946a-d19880e82f76 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.108138 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-c46d3aad-5cfa-4609-a915-e301689dbca1 req-3133c356-8984-49ad-946a-d19880e82f76 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.128992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-c46d3aad-5cfa-4609-a915-e301689dbca1 req-3133c356-8984-49ad-946a-d19880e82f76 service nova] Creating event network-changed:6c4ac575-82d3-4c88-90cb-0083321e1635 for instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 on hv-cinder-81969 Dec 07 18:46:38.144179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-c46d3aad-5cfa-4609-a915-e301689dbca1 req-3133c356-8984-49ad-946a-d19880e82f76 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060539 Dec 07 18:46:38.145035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 165/305] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:46:38.165493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:38.166251 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:38.174179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.174680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.175472 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.175916 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.302317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:38.317616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f2589a5a-1548-4f49-a561-9aec62480779 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1204 microversion: 2.1 time: 0.156160 Dec 07 18:46:38.318791 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 166/306] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:38 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1204 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:38.335501 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:38.336109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:38.342303 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.342687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.343634 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.343893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.447937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:38.460652 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-453acff5-27c9-496a-8b12-cb6e61499610 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.409924 Dec 07 18:46:38.463645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 141/307] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:38 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:38.581648 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:38.582531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:38.588730 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.589405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.590556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.591219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.938176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:38.946359 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-edeba7dd-f3c3-433a-8562-9027030159ab tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.369482 Dec 07 18:46:38.954784 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 142/308] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:38 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:38.960061 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c166bbfe-16a0-4006-8754-f3c026bbcf73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:38.961015 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c166bbfe-16a0-4006-8754-f3c026bbcf73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:38.967489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c166bbfe-16a0-4006-8754-f3c026bbcf73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.967937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c166bbfe-16a0-4006-8754-f3c026bbcf73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.968727 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c166bbfe-16a0-4006-8754-f3c026bbcf73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:38.970272 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c166bbfe-16a0-4006-8754-f3c026bbcf73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:38.979053 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:38.987264 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-93bbe903-4802-4522-8e69-82e8a4f1bf16 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1318 microversion: 2.1 time: 0.655458 Dec 07 18:46:38.988483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 167/309] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:38 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1318 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:39.081113 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c166bbfe-16a0-4006-8754-f3c026bbcf73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 11929 microversion: 2.20 time: 0.124542 Dec 07 18:46:39.082814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 143/310] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:38 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 11929 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:39.335921 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:39.336754 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:39.343508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:39.344209 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:39.345184 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:39.345761 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:39.480926 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:39.482049 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:39.509715 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:39.510395 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:39.522945 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:39.523405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:39.658016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:39.669164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-12bb3e60-7a85-4394-a9dc-f1a90455153f tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1272 microversion: 2.1 time: 0.337016 Dec 07 18:46:39.670097 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 168/311] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:39 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:39.719846 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:39.736605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7666dbab-b02e-474a-8524-a527876f4139 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.259719 Dec 07 18:46:39.737190 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 144/312] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:39 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:39.788773 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-3bd4138c-c572-4f6a-a2bd-def4f70eceee req-ad5e59ec-428a-476e-ab27-d21aa7731970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6353ff89-98cf-4e56-b677-b0f9431d7e1d", "tag": "ea0e7445-57e1-4ed8-b96b-ef483e19d0bd"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:39.790636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:39.790636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:39.807676 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-3bd4138c-c572-4f6a-a2bd-def4f70eceee req-ad5e59ec-428a-476e-ab27-d21aa7731970 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:39.808109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-3bd4138c-c572-4f6a-a2bd-def4f70eceee req-ad5e59ec-428a-476e-ab27-d21aa7731970 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:39.820571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-3bd4138c-c572-4f6a-a2bd-def4f70eceee req-ad5e59ec-428a-476e-ab27-d21aa7731970 service nova] Creating event network-changed:ea0e7445-57e1-4ed8-b96b-ef483e19d0bd for instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d on hv-cinder-81969 Dec 07 18:46:39.825367 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-3bd4138c-c572-4f6a-a2bd-def4f70eceee req-ad5e59ec-428a-476e-ab27-d21aa7731970 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040397 Dec 07 18:46:39.826063 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 169/313] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:39.963720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:39.964702 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:39.971264 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:39.971789 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:39.972568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:39.973027 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.004851 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:40.006341 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:40.012854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.013641 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.014807 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.015521 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.136309 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:40.144818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-61d2e73d-fa2d-4ecb-8539-01e1f5fa326e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.185022 Dec 07 18:46:40.145488 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 145/314] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:39 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:40.150253 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9a61daa0-a13e-4f5d-8846-6dabe9e77906 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:40.152062 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9a61daa0-a13e-4f5d-8846-6dabe9e77906 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:40.159431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a61daa0-a13e-4f5d-8846-6dabe9e77906 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.160037 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a61daa0-a13e-4f5d-8846-6dabe9e77906 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.160812 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a61daa0-a13e-4f5d-8846-6dabe9e77906 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.161435 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a61daa0-a13e-4f5d-8846-6dabe9e77906 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.236416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:40.245012 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c9ea2ed7-ed8b-4a77-99a4-acd19e3c4eb5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1509 microversion: 2.1 time: 0.244142 Dec 07 18:46:40.245943 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 170/315] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:39 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:40.265932 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9a61daa0-a13e-4f5d-8846-6dabe9e77906 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 15064 microversion: 2.20 time: 0.118879 Dec 07 18:46:40.266951 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 146/316] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:40 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 15064 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:40.686482 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:40.687192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:40.693781 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.694183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.694948 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.695374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.753895 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:40.754660 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:40.761502 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.761974 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.762759 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:40.763196 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:40.906159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:40.913663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-22342c91-afd8-44d7-a4c7-180a377e1920 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.164149 Dec 07 18:46:40.913849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:40.914273 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 147/317] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:40 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:40.921200 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e772b3e2-ac20-4178-93ec-a722dae37b3b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1272 microversion: 2.1 time: 0.238306 Dec 07 18:46:40.921995 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 171/318] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:40 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:41.161217 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:41.161748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:41.168684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.169135 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.169947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.170382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.278860 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d9aa4393-6218-4add-9438-d0f780645c42 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:41.280108 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d9aa4393-6218-4add-9438-d0f780645c42 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:41.287101 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9aa4393-6218-4add-9438-d0f780645c42 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.287543 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9aa4393-6218-4add-9438-d0f780645c42 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.288322 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9aa4393-6218-4add-9438-d0f780645c42 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.288784 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9aa4393-6218-4add-9438-d0f780645c42 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.306873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:41.314148 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-11dc7f64-8fe0-4053-a218-a1375c4ee102 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.156671 Dec 07 18:46:41.314882 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 148/319] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:41 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:41.369572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d9aa4393-6218-4add-9438-d0f780645c42 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 17834 microversion: 2.20 time: 0.095085 Dec 07 18:46:41.370246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 172/320] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:41 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 17834 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:41.496020 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8e44129c-dc03-4bb1-95e4-362215aa05f3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34e01575-7d39-4043-bf27-c17de9f148d5"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:41.497059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8e44129c-dc03-4bb1-95e4-362215aa05f3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:41.503753 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8e44129c-dc03-4bb1-95e4-362215aa05f3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.504191 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8e44129c-dc03-4bb1-95e4-362215aa05f3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.504948 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8e44129c-dc03-4bb1-95e4-362215aa05f3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.505373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8e44129c-dc03-4bb1-95e4-362215aa05f3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.738834 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8e44129c-dc03-4bb1-95e4-362215aa05f3 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "POST /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246363 Dec 07 18:46:41.743197 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 149/321] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:46:41 2021] POST /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:41.932142 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:41.932835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:41.938716 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:41.939911 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:41.940433 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.940886 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.941665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.942128 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.946149 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.946598 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:41.947372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:41.947834 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:42.081937 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:42.086836 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:42.089588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6d108391-ef33-4003-abdf-49f24dd81d1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.161498 Dec 07 18:46:42.090195 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 173/322] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:41 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:42.095497 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-aed1e7e8-090d-4409-a572-381d374bdcc1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1272 microversion: 2.1 time: 0.161151 Dec 07 18:46:42.096486 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 150/323] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:41 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:42.332149 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:42.332749 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:42.339313 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:42.339761 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:42.340549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:42.340967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:42.381521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-647cc457-fbba-44d4-a1c2-07f3bfdd361f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:42.383084 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-647cc457-fbba-44d4-a1c2-07f3bfdd361f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:42.389658 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-647cc457-fbba-44d4-a1c2-07f3bfdd361f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:42.390207 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-647cc457-fbba-44d4-a1c2-07f3bfdd361f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:42.390989 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-647cc457-fbba-44d4-a1c2-07f3bfdd361f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:42.391416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-647cc457-fbba-44d4-a1c2-07f3bfdd361f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:42.480785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:42.488597 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6765a670-b315-4a19-8fe8-66ca81931a90 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.160528 Dec 07 18:46:42.489162 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 174/324] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:42 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:42.490723 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-647cc457-fbba-44d4-a1c2-07f3bfdd361f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 18449 microversion: 2.20 time: 0.113657 Dec 07 18:46:42.491396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 151/325] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:42 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 18449 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:43.107185 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:43.107701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:43.112923 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:43.113631 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:43.114416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.114860 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.115635 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.116067 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.120405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.120870 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.121650 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.122115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.254973 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:43.256438 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:43.262416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5950aeea-1268-4869-b0f5-ffd70d6146dd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.159029 Dec 07 18:46:43.262990 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 175/326] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:43 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:43.263603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-be616063-fd9d-40b1-823a-90f950222ac4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1272 microversion: 2.1 time: 0.154849 Dec 07 18:46:43.264235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 152/327] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:43 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:43.503246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-82a2342a-072d-413e-8173-fe91e69d3306 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:43.504338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:43.504719 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-82a2342a-072d-413e-8173-fe91e69d3306 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:43.504944 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:43.510408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82a2342a-072d-413e-8173-fe91e69d3306 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.510847 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82a2342a-072d-413e-8173-fe91e69d3306 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.511013 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.511455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.511610 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82a2342a-072d-413e-8173-fe91e69d3306 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.512036 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-82a2342a-072d-413e-8173-fe91e69d3306 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.512214 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:43.512641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:43.624250 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-82a2342a-072d-413e-8173-fe91e69d3306 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 19539 microversion: 2.20 time: 0.124994 Dec 07 18:46:43.628132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 176/328] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:43 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 19539 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:43.643185 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:43.650316 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-37cc0a90-baab-4173-adaf-6ca82296e3aa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.149745 Dec 07 18:46:43.650869 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 153/329] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:43 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:44.254699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-855b8ec3-e4f3-4fd6-b312-914995b46642 req-5b84e513-fdac-49e8-b641-e4dd495159a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669946de-d56d-400a-aa4e-0b1c8ab97e46", "name": "network-vif-plugged", "status": "completed", "tag": "6c4ac575-82d3-4c88-90cb-0083321e1635"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:44.256236 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:44.256236 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:44.264150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-855b8ec3-e4f3-4fd6-b312-914995b46642 req-5b84e513-fdac-49e8-b641-e4dd495159a6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.264430 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-855b8ec3-e4f3-4fd6-b312-914995b46642 req-5b84e513-fdac-49e8-b641-e4dd495159a6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.275650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-855b8ec3-e4f3-4fd6-b312-914995b46642 req-5b84e513-fdac-49e8-b641-e4dd495159a6 service nova] Creating event network-vif-plugged:6c4ac575-82d3-4c88-90cb-0083321e1635 for instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 on hv-cinder-81969 Dec 07 18:46:44.280258 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-855b8ec3-e4f3-4fd6-b312-914995b46642 req-5b84e513-fdac-49e8-b641-e4dd495159a6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029898 Dec 07 18:46:44.280577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:44.280836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 177/330] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:46:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:46:44.281353 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:44.286233 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:44.286925 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:44.288747 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.289311 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.290527 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.291166 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.293428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.293900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.294846 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.295325 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.464898 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:44.473938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c8b7b781-248e-4f41-98c0-d2a5fd900829 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1272 microversion: 2.1 time: 0.197111 Dec 07 18:46:44.474577 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:44.474724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 154/331] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:44 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:44.483797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2fa93ea3-a941-4d54-b61f-55fbc3b063bd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.201797 Dec 07 18:46:44.486434 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 178/332] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:44 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:44.599244 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-09c7694d-c61e-4af9-8f57-744d121d6653 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:44.605084 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-09c7694d-c61e-4af9-8f57-744d121d6653 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.605484 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-09c7694d-c61e-4af9-8f57-744d121d6653 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.635232 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ebc19a3e-81f7-4ab7-be89-4ac074c35afe tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:44.636125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ebc19a3e-81f7-4ab7-be89-4ac074c35afe tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:44.642291 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ebc19a3e-81f7-4ab7-be89-4ac074c35afe tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.642728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ebc19a3e-81f7-4ab7-be89-4ac074c35afe tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.643489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ebc19a3e-81f7-4ab7-be89-4ac074c35afe tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.643913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ebc19a3e-81f7-4ab7-be89-4ac074c35afe tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.665757 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-09c7694d-c61e-4af9-8f57-744d121d6653 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Going to try to stop instance {{(pid=122586) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 07 18:46:44.710284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-09c7694d-c61e-4af9-8f57-744d121d6653 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 202 len: 0 microversion: 2.1 time: 0.115017 Dec 07 18:46:44.710877 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 155/333] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:46:44 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:44.716018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:44.716707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:44.722549 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.723001 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.723768 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.724198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.858671 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:44.872022 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-00e7918a-ad5c-4772-8c66-f9abd6ca2298 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.159345 Dec 07 18:46:44.873320 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 156/334] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:44 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:44.882246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:44.883376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:44.891680 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.892742 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.893752 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:44.894223 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:44.921576 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ebc19a3e-81f7-4ab7-be89-4ac074c35afe tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 21668 microversion: 2.20 time: 0.289884 Dec 07 18:46:44.922587 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 179/335] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:44 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 21668 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:45.037176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:45.044907 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ba24b84b-f898-475e-a370-f754e486bf49 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.170296 Dec 07 18:46:45.045479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 157/336] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:44 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:45.491316 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:45.492023 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:45.498955 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.499419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:45.500180 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.500602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:45.501231 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:45.502538 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:45.508338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.508783 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:45.509590 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.510043 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:45.636172 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:45.640751 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:45.643748 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e87c8598-a386-49e8-ac2b-980e7845140b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.156381 Dec 07 18:46:45.644324 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 180/337] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:45 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:45.648621 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f73d6893-f625-4d05-8cc6-8a62a03188c9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.150964 Dec 07 18:46:45.649257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 158/338] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:45 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:45.890116 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:45.890717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:45.896966 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.897406 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:45.898257 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.898681 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:45.934024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9b5d8afe-0ff9-49ce-ad34-933faf10c20b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:45.935115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9b5d8afe-0ff9-49ce-ad34-933faf10c20b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:45.941752 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b5d8afe-0ff9-49ce-ad34-933faf10c20b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.942336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b5d8afe-0ff9-49ce-ad34-933faf10c20b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:45.943195 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b5d8afe-0ff9-49ce-ad34-933faf10c20b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:45.943705 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b5d8afe-0ff9-49ce-ad34-933faf10c20b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:46.039715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:46.046836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e7599bc7-00c6-4d53-b117-12dc47e12166 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.160325 Dec 07 18:46:46.047383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 181/339] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:45 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:46.062618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:46.063213 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:46.069387 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:46.069836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:46.070638 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:46.071068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:46.077017 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9b5d8afe-0ff9-49ce-ad34-933faf10c20b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 22704 microversion: 2.20 time: 0.146557 Dec 07 18:46:46.078000 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 159/340] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:45 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 22704 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:46.198937 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:46.206679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fc40a7a5-345e-44a6-96a0-e9bb8a353a9d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.147379 Dec 07 18:46:46.207243 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 182/341] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:46 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:46.661357 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:46.662078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:46.665627 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:46.666288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:46.669027 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:46.669475 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:46.670475 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:46.670907 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:46.672571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:46.673022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:46.674748 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:46.675189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:46.808002 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:46.809093 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:46.816189 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cc303aa8-beb0-4231-8876-a795fad1a7e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.159035 Dec 07 18:46:46.816760 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 160/342] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:46 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:46.817853 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d92a9da1-09af-47d2-a9f4-a12c10d3d23b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.155733 Dec 07 18:46:46.818454 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 183/343] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:46 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:47.063888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:47.065121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:47.071283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.071730 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.072495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.072928 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.088441 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ff52dd1d-598a-42c1-aba4-d92807911bb3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:47.089383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ff52dd1d-598a-42c1-aba4-d92807911bb3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:47.096024 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff52dd1d-598a-42c1-aba4-d92807911bb3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.096472 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff52dd1d-598a-42c1-aba4-d92807911bb3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.097259 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff52dd1d-598a-42c1-aba4-d92807911bb3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.097686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff52dd1d-598a-42c1-aba4-d92807911bb3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.203543 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ff52dd1d-598a-42c1-aba4-d92807911bb3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 22975 microversion: 2.20 time: 0.118626 Dec 07 18:46:47.207927 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 184/344] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:47 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 22975 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:47.210700 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:47.217748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-04ebf2bc-8cc9-46b7-bd8a-220d55bcc86d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1356 microversion: 2.1 time: 0.157467 Dec 07 18:46:47.218332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 161/345] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:47 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1356 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:47.224131 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:47.224834 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:47.231746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.232200 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.233011 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.233446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.367594 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:47.375261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-755dfa75-5bf7-4460-b6a5-583ff4c9bcd1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.155171 Dec 07 18:46:47.375826 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 185/346] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:47 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:47.832674 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:47.833284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:47.834315 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:47.835180 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:47.839745 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.840190 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.841109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.841246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.841648 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.841826 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.842442 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:47.842869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:47.976980 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:47.977983 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:47.984847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-57df304c-9d40-4686-a61f-ae9a9dab6200 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.156164 Dec 07 18:46:47.985417 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 162/347] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:47 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:47.985562 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-88d3a060-42ee-48f5-837c-a80c7c8c16bf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.154688 Dec 07 18:46:47.986279 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 186/348] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:47 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:48.215868 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9ebbe1bb-9ba8-48c4-985c-407dabfbc6d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:48.216868 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9ebbe1bb-9ba8-48c4-985c-407dabfbc6d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:48.223440 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9ebbe1bb-9ba8-48c4-985c-407dabfbc6d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.223900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9ebbe1bb-9ba8-48c4-985c-407dabfbc6d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.224689 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9ebbe1bb-9ba8-48c4-985c-407dabfbc6d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.225130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9ebbe1bb-9ba8-48c4-985c-407dabfbc6d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.236298 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:48.237037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:48.243643 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.244095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.244867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.245299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.341392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9ebbe1bb-9ba8-48c4-985c-407dabfbc6d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 23789 microversion: 2.20 time: 0.129013 Dec 07 18:46:48.345365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 163/349] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:48 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 23789 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:48.378970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:48.386227 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-50c19e38-8dfc-458e-b285-54f2b754095b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1545 microversion: 2.1 time: 0.154310 Dec 07 18:46:48.386794 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 187/350] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:48 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:48.394292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:48.394989 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:48.401970 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.402411 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.402668 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:48.403193 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.403311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:48.403631 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.409163 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.409692 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.410691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.411205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.542417 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:48.543537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:48.550598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bc3a6cb6-4844-438c-81e4-bf6287cce2cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1545 microversion: 2.1 time: 0.151340 Dec 07 18:46:48.551312 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 188/351] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:48 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:48.555930 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c0abd6f9-eec9-4ae2-b773-19c09524b8f3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.166551 Dec 07 18:46:48.556534 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 164/352] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:48 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:48.566049 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:48.569548 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:46:48.569548 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:46:48.570568 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:48.571312 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Searching by: {'deleted': False, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d'} {{(pid=122585) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 07 18:46:48.577852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.578328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.579121 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.579620 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.665652 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.multi_cell_list [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 07 18:46:48.759242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bfb5c710-723f-4a80-8d4f-5e164035d9c9 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.196640 Dec 07 18:46:48.759828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 189/353] 10.222.0.41 () {58 vars in 1124 bytes} [Tue Dec 7 18:46:48 2021] GET /compute/v2.1/servers => generated 341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:46:48.770233 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:48.770843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:48.777225 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.777679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.778524 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:48.778961 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:48.906779 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:48.913825 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-867ff8dd-de3b-4993-9b21-1d2bda20dafa tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1545 microversion: 2.1 time: 0.147864 Dec 07 18:46:48.914541 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 165/354] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:48 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1545 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:49.002714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:49.003590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:49.003778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:49.004916 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:49.010223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.010723 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.011506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.011932 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.013941 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.014432 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.015264 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.015799 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.172895 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:49.183202 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-937d8dd0-18bb-4d73-a210-8652f9cb960d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.184602 Dec 07 18:46:49.191382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 166/355] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:48 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:49.191488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:49.196637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9c248306-df93-48bc-849a-519ea1d2f124 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.198136 Dec 07 18:46:49.197548 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 190/356] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:48 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:49.352391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d8698b21-a967-4181-b370-866af56c4cff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:49.353365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d8698b21-a967-4181-b370-866af56c4cff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:49.359127 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8698b21-a967-4181-b370-866af56c4cff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.359577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8698b21-a967-4181-b370-866af56c4cff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.360341 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8698b21-a967-4181-b370-866af56c4cff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.361423 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8698b21-a967-4181-b370-866af56c4cff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.472762 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d8698b21-a967-4181-b370-866af56c4cff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 24333 microversion: 2.20 time: 0.123807 Dec 07 18:46:49.473532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 167/357] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:49 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 24333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:49.575445 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:49.576068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:49.582186 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.582637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.583402 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:49.583835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:49.715619 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:49.724468 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7406dbac-7fa0-400e-84ae-d250bfca3c19 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.154255 Dec 07 18:46:49.724970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 191/358] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:49 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:50.211351 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:50.211351 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:50.218183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:50.219013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:50.219358 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.219880 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:50.220819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.221321 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:50.226587 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.227042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:50.227844 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.228278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:50.374476 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:50.378848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:50.382532 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-460b58c2-c3d7-4cc8-8902-ca06806ca1fe tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.168823 Dec 07 18:46:50.383109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 192/359] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:50 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:50.386008 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-55233c69-857b-47b7-82fa-a151a10cbbff tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.181051 Dec 07 18:46:50.386804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 168/360] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:50 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:50.387460 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4628c910-4bcf-4401-b659-a652ed8a2895 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "892a3528-56df-4681-a160-da10a2b284c7"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:50.388541 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4628c910-4bcf-4401-b659-a652ed8a2895 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:50.394421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4628c910-4bcf-4401-b659-a652ed8a2895 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.394946 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4628c910-4bcf-4401-b659-a652ed8a2895 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:50.395714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4628c910-4bcf-4401-b659-a652ed8a2895 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.396145 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4628c910-4bcf-4401-b659-a652ed8a2895 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:50.485308 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2bc17dfc-b03a-4b3c-b07d-0227f0104982 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:50.486786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2bc17dfc-b03a-4b3c-b07d-0227f0104982 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:50.492839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc17dfc-b03a-4b3c-b07d-0227f0104982 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.493277 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc17dfc-b03a-4b3c-b07d-0227f0104982 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:50.494076 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc17dfc-b03a-4b3c-b07d-0227f0104982 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:50.494505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc17dfc-b03a-4b3c-b07d-0227f0104982 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:53.048279 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2bc17dfc-b03a-4b3c-b07d-0227f0104982 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 25642 microversion: 2.20 time: 2.566375 Dec 07 18:46:53.052555 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 169/361] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:50 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 25642 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:53.055080 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:53.055972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:53.062937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:53.063416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:53.064939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:53.065677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:53.130469 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4628c910-4bcf-4401-b659-a652ed8a2895 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.745661 Dec 07 18:46:53.131106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 193/362] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:46:50 2021] POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments => generated 194 bytes in 2747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:53.140086 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:53.140898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:53.148209 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:53.148725 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:53.149552 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:53.150049 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:53.232307 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:53.241005 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c82e459f-a634-4efe-ab6a-8a701eda8d63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.189953 Dec 07 18:46:53.241857 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 170/363] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:53 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:53.246170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:53.246765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:53.253841 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:53.254327 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:53.255109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:53.255572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:53.295286 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:53.303142 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d9e7fb4e-bf28-48cd-be0e-f5ed2dd4d77d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.170449 Dec 07 18:46:53.303997 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 194/364] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:53 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:53.390485 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:53.398872 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1e17f071-c951-4f2c-b004-b87cded585e2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.156062 Dec 07 18:46:53.399435 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 171/365] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:53 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:54.059153 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b2267bdf-acdb-4276-810b-920758545636 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:54.060105 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b2267bdf-acdb-4276-810b-920758545636 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:54.066266 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2267bdf-acdb-4276-810b-920758545636 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.066711 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2267bdf-acdb-4276-810b-920758545636 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.067463 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2267bdf-acdb-4276-810b-920758545636 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.067888 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2267bdf-acdb-4276-810b-920758545636 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.161268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b2267bdf-acdb-4276-810b-920758545636 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 26424 microversion: 2.20 time: 0.105627 Dec 07 18:46:54.161902 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 195/366] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:54 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 26424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:54.257992 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:54.258608 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:54.264786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.265235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.266171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.266730 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.320897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:54.321589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:54.330047 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.331360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.333297 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.334073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.418276 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:54.428319 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0f9690e8-1971-482c-b2be-4701a8379edc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.173969 Dec 07 18:46:54.439104 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 172/367] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:54 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:54.444740 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:54.445513 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:54.451535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.452012 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.452818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.453257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.485366 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:54.494735 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b4574662-476e-4bc9-852d-516396ca00e8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.177717 Dec 07 18:46:54.495520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 196/368] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:54 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:54.586050 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:54.586468 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:54.592644 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.593086 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.594131 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.594866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.605060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:54.613839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b3464255-dafc-4bf6-a3a8-5dc5702365cf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.173388 Dec 07 18:46:54.614511 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 173/369] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:54 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:54.690291 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lazy-loading 'services' on Instance uuid fb71bb34-2f82-45de-91ba-98a927600c63 {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:46:54.766098 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2098f789-6c78-4f23-9b52-fa48e9b32c51 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments/34e01575-7d39-4043-bf27-c17de9f148d5" status: 202 len: 0 microversion: 2.1 time: 0.183734 Dec 07 18:46:54.767804 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 197/370] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:46:54 2021] DELETE /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments/34e01575-7d39-4043-bf27-c17de9f148d5 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:46:54.776121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-34ec24e9-e66e-498a-b20b-f003e81c797e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:54.777023 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-34ec24e9-e66e-498a-b20b-f003e81c797e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:54.783719 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34ec24e9-e66e-498a-b20b-f003e81c797e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.784164 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34ec24e9-e66e-498a-b20b-f003e81c797e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.784939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34ec24e9-e66e-498a-b20b-f003e81c797e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:54.785372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34ec24e9-e66e-498a-b20b-f003e81c797e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:54.823566 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-34ec24e9-e66e-498a-b20b-f003e81c797e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050991 Dec 07 18:46:54.824038 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 174/371] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:46:54 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:55.174623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2604bd36-1536-4e92-8459-472b1d29d484 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:55.175551 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2604bd36-1536-4e92-8459-472b1d29d484 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:55.182276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2604bd36-1536-4e92-8459-472b1d29d484 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.182716 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2604bd36-1536-4e92-8459-472b1d29d484 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.183470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2604bd36-1536-4e92-8459-472b1d29d484 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.183893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2604bd36-1536-4e92-8459-472b1d29d484 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.272076 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2604bd36-1536-4e92-8459-472b1d29d484 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 27046 microversion: 2.20 time: 0.102457 Dec 07 18:46:55.275980 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 198/372] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:55 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 27046 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:55.445578 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:55.446271 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:55.452053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.452497 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.453259 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.453689 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.513055 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:55.513738 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:55.521189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.521628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.522418 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.522840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.583251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:55.595397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bd68484c-5c75-4d88-9960-38b61560cdd0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.151024 Dec 07 18:46:55.596004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 175/373] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:55 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:55.631422 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:55.632155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:55.638035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.638491 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.639270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.639703 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.665125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:55.674311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-06683daf-f793-4975-980c-8999e603c392 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.164461 Dec 07 18:46:55.674898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 199/374] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:55 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:55.773286 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:55.780523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-32117b24-28a6-4465-887c-de7652a6cef5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.152782 Dec 07 18:46:55.781118 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 176/375] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:55 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:55.834914 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6247c1f7-4851-4640-a9cc-fa1cdfabd5d0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:55.835832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6247c1f7-4851-4640-a9cc-fa1cdfabd5d0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:55.842117 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6247c1f7-4851-4640-a9cc-fa1cdfabd5d0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.842712 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6247c1f7-4851-4640-a9cc-fa1cdfabd5d0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.843346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6247c1f7-4851-4640-a9cc-fa1cdfabd5d0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:55.843779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6247c1f7-4851-4640-a9cc-fa1cdfabd5d0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:55.872692 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6247c1f7-4851-4640-a9cc-fa1cdfabd5d0 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041520 Dec 07 18:46:55.873249 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 200/376] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:46:55 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:56.283603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9dcc81a7-5b3b-4345-b7ec-59c6a358e9d2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:56.284522 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9dcc81a7-5b3b-4345-b7ec-59c6a358e9d2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:56.290660 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9dcc81a7-5b3b-4345-b7ec-59c6a358e9d2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.291106 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9dcc81a7-5b3b-4345-b7ec-59c6a358e9d2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.291914 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9dcc81a7-5b3b-4345-b7ec-59c6a358e9d2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.292345 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9dcc81a7-5b3b-4345-b7ec-59c6a358e9d2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.382532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9dcc81a7-5b3b-4345-b7ec-59c6a358e9d2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 27679 microversion: 2.20 time: 0.102906 Dec 07 18:46:56.386450 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 177/377] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:56 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 27679 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:56.614446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:56.614992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:56.622667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.623113 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.623886 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.624314 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.691369 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:56.692056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:56.698800 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.699246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.700021 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.700447 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.764336 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:56.772509 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-73acca3d-877c-41b6-bf0f-0aea519c5bed tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.162569 Dec 07 18:46:56.786410 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 201/378] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:56 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:56.799492 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:56.801038 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:56.806894 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.807340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.808121 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:56.808547 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:56.980704 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:56.990596 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c5968588-b5d7-495d-94a6-07ef5c08202c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.195141 Dec 07 18:46:57.000834 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 202/379] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:56 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:57.006481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3249258c-6c71-43e9-a52c-25223227283d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:57.007656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3249258c-6c71-43e9-a52c-25223227283d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:57.014765 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3249258c-6c71-43e9-a52c-25223227283d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:57.015383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3249258c-6c71-43e9-a52c-25223227283d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:57.016328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3249258c-6c71-43e9-a52c-25223227283d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:57.017717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3249258c-6c71-43e9-a52c-25223227283d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:57.053388 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3249258c-6c71-43e9-a52c-25223227283d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050545 Dec 07 18:46:57.054183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 203/380] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:46:57 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:46:57.076866 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:57.084819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ffcba450-ff8b-48ed-b34f-2715a761578a tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.398050 Dec 07 18:46:57.085385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 178/381] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:56 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:57.395287 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2471701b-cdc6-4a79-8669-dd5e3df26f71 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:57.396197 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2471701b-cdc6-4a79-8669-dd5e3df26f71 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:57.403709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2471701b-cdc6-4a79-8669-dd5e3df26f71 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:57.404656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2471701b-cdc6-4a79-8669-dd5e3df26f71 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:57.405458 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2471701b-cdc6-4a79-8669-dd5e3df26f71 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:57.405892 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2471701b-cdc6-4a79-8669-dd5e3df26f71 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:57.517352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2471701b-cdc6-4a79-8669-dd5e3df26f71 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28035 microversion: 2.20 time: 0.126555 Dec 07 18:46:57.518020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 204/382] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:57 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28035 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:57.795116 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:57.795870 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:57.803054 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:57.803497 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:57.804286 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:57.804711 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:57.933303 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:57.941103 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2123a6b0-548c-4aa5-919a-c09afee5492f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.149783 Dec 07 18:46:57.941659 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 179/383] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:57 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:58.008000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:58.008683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:58.015390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.015833 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.016588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.017781 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.064599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4c61476a-c82c-4754-b1b8-22d1ef48b807 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:58.065576 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4c61476a-c82c-4754-b1b8-22d1ef48b807 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:58.071635 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c61476a-c82c-4754-b1b8-22d1ef48b807 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.072160 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c61476a-c82c-4754-b1b8-22d1ef48b807 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.073016 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c61476a-c82c-4754-b1b8-22d1ef48b807 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.073522 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c61476a-c82c-4754-b1b8-22d1ef48b807 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.104002 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4c61476a-c82c-4754-b1b8-22d1ef48b807 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Dec 07 18:46:58.104566 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 180/384] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:46:58 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:46:58.109558 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:58.110184 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:58.115960 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.116412 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.117191 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.117625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.152845 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:58.161022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e4e410c9-e628-4935-9df4-a0a70d2590d4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.156953 Dec 07 18:46:58.161604 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 205/385] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:58 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:58.245822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:58.253181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cafa0261-acea-4f0d-90d9-badda91fae24 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.146935 Dec 07 18:46:58.253762 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 181/386] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:58 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:58.528932 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a5ef7f7f-0565-4bec-ac4f-b7250db36b75 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:58.529831 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a5ef7f7f-0565-4bec-ac4f-b7250db36b75 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:58.536079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5ef7f7f-0565-4bec-ac4f-b7250db36b75 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.536515 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5ef7f7f-0565-4bec-ac4f-b7250db36b75 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.537272 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5ef7f7f-0565-4bec-ac4f-b7250db36b75 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.537696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5ef7f7f-0565-4bec-ac4f-b7250db36b75 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.666415 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a5ef7f7f-0565-4bec-ac4f-b7250db36b75 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28212 microversion: 2.20 time: 0.140832 Dec 07 18:46:58.666974 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 206/387] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:58 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:46:58.958697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:58.959298 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:58.965419 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.965862 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:58.966652 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:58.967081 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.103002 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:59.110971 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f420747b-a23a-4c3d-8bac-55f7043cb1bc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.156247 Dec 07 18:46:59.111539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 182/388] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:58 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:59.115448 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2345e7ff-a7b2-4084-94e0-7e5e066bf1c4 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:59.116490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2345e7ff-a7b2-4084-94e0-7e5e066bf1c4 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:59.123079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2345e7ff-a7b2-4084-94e0-7e5e066bf1c4 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.123517 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2345e7ff-a7b2-4084-94e0-7e5e066bf1c4 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.124276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2345e7ff-a7b2-4084-94e0-7e5e066bf1c4 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.124701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2345e7ff-a7b2-4084-94e0-7e5e066bf1c4 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.155765 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2345e7ff-a7b2-4084-94e0-7e5e066bf1c4 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Dec 07 18:46:59.156309 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 207/389] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:46:59 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:46:59.178750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:59.179360 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:59.185334 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.185789 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.186593 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.187057 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.270082 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:46:59.270690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:59.277144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.277584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.278377 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.278807 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.315953 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:59.323454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0976692c-647f-4619-b087-97851306c6f7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.148587 Dec 07 18:46:59.324126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 183/390] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:59 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:46:59.411517 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:46:59.418940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6dfd8630-427a-492b-be0b-5248d8a6d7b5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.152774 Dec 07 18:46:59.419507 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 208/391] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:46:59 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:46:59.678066 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ecd638dd-7a66-441b-b9dc-419a65068308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:46:59.678946 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ecd638dd-7a66-441b-b9dc-419a65068308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:46:59.684830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecd638dd-7a66-441b-b9dc-419a65068308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.685275 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecd638dd-7a66-441b-b9dc-419a65068308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.686071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecd638dd-7a66-441b-b9dc-419a65068308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:46:59.686503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecd638dd-7a66-441b-b9dc-419a65068308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:46:59.827499 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ecd638dd-7a66-441b-b9dc-419a65068308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28436 microversion: 2.20 time: 0.153340 Dec 07 18:46:59.828390 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 184/392] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:46:59 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28436 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:00.129115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:00.129750 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:00.136207 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.136616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.137465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.138080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.168003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b6d1b5c4-7733-40de-ab72-1185d22f035a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:00.169021 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b6d1b5c4-7733-40de-ab72-1185d22f035a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:00.176729 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6d1b5c4-7733-40de-ab72-1185d22f035a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.177173 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6d1b5c4-7733-40de-ab72-1185d22f035a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.177956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6d1b5c4-7733-40de-ab72-1185d22f035a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.178390 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6d1b5c4-7733-40de-ab72-1185d22f035a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.210039 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b6d1b5c4-7733-40de-ab72-1185d22f035a tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045982 Dec 07 18:47:00.214098 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 185/393] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:47:00 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:47:00.276715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:00.284409 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e156a9a1-438a-40ed-bf00-82f123d60490 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.159724 Dec 07 18:47:00.284988 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 209/394] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:00 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:00.340625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:00.341372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:00.348091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.348628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.349485 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.350025 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.350772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-e080c86c-ed2e-44b2-9e60-a3748b98ea71 req-db02e23f-d12f-4296-84b6-e9af9ea3d35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6353ff89-98cf-4e56-b677-b0f9431d7e1d", "name": "network-vif-plugged", "status": "completed", "tag": "ea0e7445-57e1-4ed8-b96b-ef483e19d0bd"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:00.352358 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:00.352358 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:00.359829 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-e080c86c-ed2e-44b2-9e60-a3748b98ea71 req-db02e23f-d12f-4296-84b6-e9af9ea3d35e service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.360271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-e080c86c-ed2e-44b2-9e60-a3748b98ea71 req-db02e23f-d12f-4296-84b6-e9af9ea3d35e service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.372766 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-e080c86c-ed2e-44b2-9e60-a3748b98ea71 req-db02e23f-d12f-4296-84b6-e9af9ea3d35e service nova] Creating event network-vif-plugged:ea0e7445-57e1-4ed8-b96b-ef483e19d0bd for instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d on hv-cinder-81969 Dec 07 18:47:00.378456 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-e080c86c-ed2e-44b2-9e60-a3748b98ea71 req-db02e23f-d12f-4296-84b6-e9af9ea3d35e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Dec 07 18:47:00.379071 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 210/395] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:00.439045 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:00.439904 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:00.446293 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.446812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.447656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.448145 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.496025 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:00.503372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-872ba5fb-9b43-4303-b648-859a64c7e60c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.166669 Dec 07 18:47:00.503947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 186/396] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:00 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:00.584529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:00.591762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8416f837-5935-449a-a12f-d37a7c8fc139 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.157362 Dec 07 18:47:00.592366 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 211/397] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:00 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:00.839800 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-72093567-bfb5-404e-8111-dbf1207e1c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:00.840796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-72093567-bfb5-404e-8111-dbf1207e1c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:00.849262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72093567-bfb5-404e-8111-dbf1207e1c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.849706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72093567-bfb5-404e-8111-dbf1207e1c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:00.850517 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72093567-bfb5-404e-8111-dbf1207e1c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:00.850946 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72093567-bfb5-404e-8111-dbf1207e1c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.194206 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-72093567-bfb5-404e-8111-dbf1207e1c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28577 microversion: 2.20 time: 0.357905 Dec 07 18:47:01.194855 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 187/398] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:00 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28577 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:01.221743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-78a16105-8696-4408-9c3a-9e0ac4446663 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:01.222713 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-78a16105-8696-4408-9c3a-9e0ac4446663 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:01.229321 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78a16105-8696-4408-9c3a-9e0ac4446663 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.229772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78a16105-8696-4408-9c3a-9e0ac4446663 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.230588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78a16105-8696-4408-9c3a-9e0ac4446663 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.231022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78a16105-8696-4408-9c3a-9e0ac4446663 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.259382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-78a16105-8696-4408-9c3a-9e0ac4446663 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Dec 07 18:47:01.259954 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 212/399] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:47:01 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:01.302460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:01.303156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:01.310018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.310471 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.311250 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.311687 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.442688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:01.450936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2f4dfa9a-ce8d-4706-8b45-cd419f9a3946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.152965 Dec 07 18:47:01.451442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 188/400] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:01 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:01.521495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:01.522226 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:01.527907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.528345 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.529109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.529532 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.608155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:01.608763 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:01.615162 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.615601 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.616366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:01.616794 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:01.664100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:01.671198 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-51b267db-3c26-4bef-8d9d-31c3a36a72be tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.153385 Dec 07 18:47:01.671774 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 213/401] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:01 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:01.748521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:01.756723 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d2caabfe-44f1-428e-9f13-28e04e5b51df tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.152074 Dec 07 18:47:01.757285 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 189/402] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:01 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:02.206363 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bf72d36d-9eab-4ab9-a63b-31a8dfee020e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:02.207267 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bf72d36d-9eab-4ab9-a63b-31a8dfee020e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:02.213234 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf72d36d-9eab-4ab9-a63b-31a8dfee020e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.213681 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf72d36d-9eab-4ab9-a63b-31a8dfee020e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.214498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf72d36d-9eab-4ab9-a63b-31a8dfee020e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.214964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf72d36d-9eab-4ab9-a63b-31a8dfee020e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.271668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c927c085-86ff-4b60-882d-d37d3c9fce6d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:02.272659 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c927c085-86ff-4b60-882d-d37d3c9fce6d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:02.279031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c927c085-86ff-4b60-882d-d37d3c9fce6d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.279480 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c927c085-86ff-4b60-882d-d37d3c9fce6d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.280252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c927c085-86ff-4b60-882d-d37d3c9fce6d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.280701 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c927c085-86ff-4b60-882d-d37d3c9fce6d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.310242 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c927c085-86ff-4b60-882d-d37d3c9fce6d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042262 Dec 07 18:47:02.310789 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 190/403] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:47:02 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:47:02.325851 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bf72d36d-9eab-4ab9-a63b-31a8dfee020e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28577 microversion: 2.20 time: 0.123674 Dec 07 18:47:02.326532 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 214/404] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:02 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28577 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:02.468642 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:02.469182 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:02.474995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.475445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.476240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.476674 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.608665 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:02.617757 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d89bf6a4-1d7d-4d07-934b-d02373fdedf0 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.152765 Dec 07 18:47:02.618368 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 191/405] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:02 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:02.689775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:02.690525 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:02.697411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.697855 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.698686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.699114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.766010 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:02.767184 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:02.777773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.778240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.779018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.779445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.835682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:02.842861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c2fd6833-ce43-42d9-9987-1209d9a00d2a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.157798 Dec 07 18:47:02.843428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 215/406] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:02 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:02.848598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:02.849190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:02.854746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.855187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.855952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:02.856379 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:02.909204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:02.916857 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ab716fc7-aa92-45aa-a3f8-48240f802fc2 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1591 microversion: 2.1 time: 0.154563 Dec 07 18:47:02.917418 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 192/407] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:02 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1591 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:02.993771 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:03.002579 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3f498c74-8747-4521-b87b-55a87b85068b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1260 microversion: 2.1 time: 0.156925 Dec 07 18:47:03.003040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 216/408] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:02 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:03.323014 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5b947ab8-9453-43bb-881b-c98aec51d1ac tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:03.324037 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5b947ab8-9453-43bb-881b-c98aec51d1ac tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:03.330455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b947ab8-9453-43bb-881b-c98aec51d1ac tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.331098 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b947ab8-9453-43bb-881b-c98aec51d1ac tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.332059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b947ab8-9453-43bb-881b-c98aec51d1ac tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.332623 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b947ab8-9453-43bb-881b-c98aec51d1ac tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.338525 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-88217741-6be0-4352-9373-7eb03c31739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:03.339549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-88217741-6be0-4352-9373-7eb03c31739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:03.353742 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88217741-6be0-4352-9373-7eb03c31739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.354359 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88217741-6be0-4352-9373-7eb03c31739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.355435 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88217741-6be0-4352-9373-7eb03c31739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.356089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-88217741-6be0-4352-9373-7eb03c31739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.364483 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5b947ab8-9453-43bb-881b-c98aec51d1ac tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045545 Dec 07 18:47:03.365385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 193/409] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:47:03 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:47:03.460179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-88217741-6be0-4352-9373-7eb03c31739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28577 microversion: 2.20 time: 0.125306 Dec 07 18:47:03.461597 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 217/410] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:03 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28577 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:47:03.635642 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:03.636250 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:03.642210 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.642655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.643428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.643867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.861732 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:03.862471 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:03.869227 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.869699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.870494 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:03.870923 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:03.882746 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:03.891403 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3a382dd9-c858-4e34-a3ce-1f7c0174df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.259435 Dec 07 18:47:03.892768 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 194/411] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:03 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:04.006037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:04.014034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-afab8e04-7ffa-4cbc-a886-84a0da8d4a8a tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.156739 Dec 07 18:47:04.014802 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 218/412] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:03 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:04.019365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:04.019976 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:04.026075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.026585 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.027315 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.027748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.281643 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:04.289179 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-70a35d5c-4e56-44d0-8e2d-632ba88a67bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1444 microversion: 2.1 time: 0.274071 Dec 07 18:47:04.289752 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 195/413] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:04 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1444 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:04.306531 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:04.307133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:04.313182 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.314415 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.315371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.315802 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.448453 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:04.456082 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fc03da62-0025-44a6-b78a-b173fba297ea tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1444 microversion: 2.1 time: 0.153126 Dec 07 18:47:04.456741 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 219/414] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:04 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:04.472592 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d9eacb38-3ad0-48e4-8020-0c41a2d82d57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:04.474137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d9eacb38-3ad0-48e4-8020-0c41a2d82d57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:04.480713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9eacb38-3ad0-48e4-8020-0c41a2d82d57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.481160 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9eacb38-3ad0-48e4-8020-0c41a2d82d57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.481956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9eacb38-3ad0-48e4-8020-0c41a2d82d57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.482391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9eacb38-3ad0-48e4-8020-0c41a2d82d57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.561212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:04.561830 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:04.569415 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.570239 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.572970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.574789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.609490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:47:04.620724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d9eacb38-3ad0-48e4-8020-0c41a2d82d57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28577 microversion: 2.20 time: 0.152136 Dec 07 18:47:04.622748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 196/415] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:04 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:04.696519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-19de74e9-fd24-4912-babf-4ae0a80ea15c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 204 len: 0 microversion: 2.1 time: 0.138686 Dec 07 18:47:04.697449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 220/416] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:47:04 2021] DELETE /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 07 18:47:04.710756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:04.711745 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:04.719031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.720239 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.721205 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.722710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.909760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:04.910470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:04.916408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.916865 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:04.917858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:04.918489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:05.181058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:05.186386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:05.191708 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6c9b4add-b483-40de-8e81-af6fd1212204 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1515 microversion: 2.1 time: 0.486752 Dec 07 18:47:05.192382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 197/417] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:04 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1515 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:05.197155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:05.197371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-eac4def2-46df-4b8d-aded-6c770f07c234 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.292211 Dec 07 18:47:05.209007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:05.209293 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 221/418] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:04 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:05.209377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:05.209377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:05.209377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:05.209377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:05.434589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:05.448624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e453bc76-1734-4ced-8053-e67ef3982a3b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.254530 Dec 07 18:47:05.449818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 198/419] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:05 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:05.481002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-9385cff9-f5e4-4576-a1cb-377beeba5e1f req-253feccf-e98f-4803-a95e-8dba44f50273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669946de-d56d-400a-aa4e-0b1c8ab97e46", "tag": "6c4ac575-82d3-4c88-90cb-0083321e1635"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:05.482590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:05.482590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:05.490301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-9385cff9-f5e4-4576-a1cb-377beeba5e1f req-253feccf-e98f-4803-a95e-8dba44f50273 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:05.490740 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-9385cff9-f5e4-4576-a1cb-377beeba5e1f req-253feccf-e98f-4803-a95e-8dba44f50273 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:05.502414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-9385cff9-f5e4-4576-a1cb-377beeba5e1f req-253feccf-e98f-4803-a95e-8dba44f50273 service nova] Creating event network-changed:6c4ac575-82d3-4c88-90cb-0083321e1635 for instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 on hv-cinder-81969 Dec 07 18:47:05.507549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-9385cff9-f5e4-4576-a1cb-377beeba5e1f req-253feccf-e98f-4803-a95e-8dba44f50273 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030092 Dec 07 18:47:05.508502 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 222/420] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:05.635136 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-115e08bd-8208-4712-ab61-3bd711d76589 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:05.636562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-115e08bd-8208-4712-ab61-3bd711d76589 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:05.643558 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-115e08bd-8208-4712-ab61-3bd711d76589 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:05.644015 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-115e08bd-8208-4712-ab61-3bd711d76589 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:05.644807 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-115e08bd-8208-4712-ab61-3bd711d76589 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:05.645245 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-115e08bd-8208-4712-ab61-3bd711d76589 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:05.777347 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-115e08bd-8208-4712-ab61-3bd711d76589 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28577 microversion: 2.20 time: 0.146423 Dec 07 18:47:05.781410 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 199/421] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:05 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:06.210539 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:06.211544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:06.216537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:06.217500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:06.226357 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.227586 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.228557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.229178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.233366 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.234022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.234879 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.235378 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.474771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:06.482872 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ccc87e86-ff64-4248-93ed-7287d58b4d82 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.270270 Dec 07 18:47:06.483462 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 200/422] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:06 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:06.497192 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:06.497891 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:06.505373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.511344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.512527 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.513194 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.611106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:06.622820 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3e7f2c91-bd87-4b40-b665-3ff7f1326c7d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1515 microversion: 2.1 time: 0.417078 Dec 07 18:47:06.625325 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 223/423] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:06 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1515 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:06.759083 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:06.774867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0c1d1a80-1926-4951-a8f5-c8a0741a45c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1503 microversion: 2.1 time: 0.290091 Dec 07 18:47:06.786415 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 201/424] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:06 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:06.791894 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b2e2c576-1f30-4972-a48d-eabb66a6f6c8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:06.793428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1d3243e-d711-41df-815a-4aa3bdd83693"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:06.793609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b2e2c576-1f30-4972-a48d-eabb66a6f6c8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:06.794788 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:06.801496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.802305 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.803331 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.804847 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2e2c576-1f30-4972-a48d-eabb66a6f6c8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.805263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.805396 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2e2c576-1f30-4972-a48d-eabb66a6f6c8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.806114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2e2c576-1f30-4972-a48d-eabb66a6f6c8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.806898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2e2c576-1f30-4972-a48d-eabb66a6f6c8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.833780 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] HTTP exception thrown: Cannot 'attach_volume' instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f while it is in vm_state rescued Dec 07 18:47:06.835286 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Returning 409 to user: Cannot 'attach_volume' instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f while it is in vm_state rescued {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:06.836374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-46c4137d-e9e7-4c10-9264-f067a0540776 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047924 Dec 07 18:47:06.841094 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 202/425] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:47:06 2021] POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 07 18:47:06.846641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8ffd55dc-cd63-41f8-a89e-300b6e8d3f3e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:06.847453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8ffd55dc-cd63-41f8-a89e-300b6e8d3f3e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:06.853710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ffd55dc-cd63-41f8-a89e-300b6e8d3f3e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.854427 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ffd55dc-cd63-41f8-a89e-300b6e8d3f3e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.855420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ffd55dc-cd63-41f8-a89e-300b6e8d3f3e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.856208 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ffd55dc-cd63-41f8-a89e-300b6e8d3f3e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.936720 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b2e2c576-1f30-4972-a48d-eabb66a6f6c8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28862 microversion: 2.20 time: 0.150966 Dec 07 18:47:06.937428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 224/426] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:06 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28862 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:06.941253 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8ffd55dc-cd63-41f8-a89e-300b6e8d3f3e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action" status: 202 len: 0 microversion: 2.1 time: 0.098217 Dec 07 18:47:06.941881 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 203/427] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:47:06 2021] POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:06.957198 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:06.958864 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:06.970598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.971270 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:06.972265 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:06.972781 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:07.302763 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:07.311004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3b3a01cf-b5da-4af4-9fd6-dd9a0cf879b4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1511 microversion: 2.1 time: 0.363570 Dec 07 18:47:07.321439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 225/428] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:06 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:07.405578 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2109883156"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:07.406485 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:07.413407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:07.414388 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:07.415170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:07.415604 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:07.501627 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:07.502397 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:07.508653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:07.509114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:07.509956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:07.510551 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:07.633852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.network.security_group_api [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Adding security group 07b8a811-66f4-4a24-808c-06e6dc4476b7 to port 6c4ac575-82d3-4c88-90cb-0083321e1635 Dec 07 18:47:07.697188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:07.707819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ceff3abe-aef0-4b17-8a40-2e433d869448 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.209955 Dec 07 18:47:07.718405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 226/429] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:07 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:07.718405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-a0d239c0-4d6a-44ca-b1e9-8dbac5f83c1d req-f7389c50-bd1a-4323-a990-af403ef94de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6353ff89-98cf-4e56-b677-b0f9431d7e1d", "tag": "ea0e7445-57e1-4ed8-b96b-ef483e19d0bd"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:07.718405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:07.718405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:07.725079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-a0d239c0-4d6a-44ca-b1e9-8dbac5f83c1d req-f7389c50-bd1a-4323-a990-af403ef94de0 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:07.725633 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-a0d239c0-4d6a-44ca-b1e9-8dbac5f83c1d req-f7389c50-bd1a-4323-a990-af403ef94de0 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:07.738972 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-a0d239c0-4d6a-44ca-b1e9-8dbac5f83c1d req-f7389c50-bd1a-4323-a990-af403ef94de0 service nova] Creating event network-changed:ea0e7445-57e1-4ed8-b96b-ef483e19d0bd for instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d on hv-cinder-81969 Dec 07 18:47:07.749848 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-a0d239c0-4d6a-44ca-b1e9-8dbac5f83c1d req-f7389c50-bd1a-4323-a990-af403ef94de0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038957 Dec 07 18:47:07.751483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 227/430] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:07.758495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:07.759410 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:07.766719 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:07.767154 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:07.768172 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:07.768828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.008491 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:08.015799 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8c46c82f-00ef-4aa4-9903-8c14e0b8a779 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1515 microversion: 2.1 time: 0.263028 Dec 07 18:47:08.026956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 228/431] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:07 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1515 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:08.033148 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c2c12995-b939-4bb9-a0fc-99546f3303b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:08.034314 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c2c12995-b939-4bb9-a0fc-99546f3303b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:08.041610 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2c12995-b939-4bb9-a0fc-99546f3303b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.042168 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2c12995-b939-4bb9-a0fc-99546f3303b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.042955 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2c12995-b939-4bb9-a0fc-99546f3303b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.043378 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c2c12995-b939-4bb9-a0fc-99546f3303b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.110782 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9333066c-2ebc-4e15-b89a-1fa9c810f73e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/action" status: 202 len: 0 microversion: 2.1 time: 0.709315 Dec 07 18:47:08.114720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 204/432] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:47:07 2021] POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:08.119643 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:08.120342 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:08.130174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.132755 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.135897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.137044 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.219400 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c2c12995-b939-4bb9-a0fc-99546f3303b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 28864 microversion: 2.20 time: 0.190908 Dec 07 18:47:08.220386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 229/433] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:08 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 28864 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:08.237300 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-b01a7dfd-432c-4b78-807e-e24fab6557a5 req-1fb83403-74e2-483f-bf87-06a1b491dc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669946de-d56d-400a-aa4e-0b1c8ab97e46", "tag": "6c4ac575-82d3-4c88-90cb-0083321e1635"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:08.239104 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:08.239104 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:08.262301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b01a7dfd-432c-4b78-807e-e24fab6557a5 req-1fb83403-74e2-483f-bf87-06a1b491dc13 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.262984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b01a7dfd-432c-4b78-807e-e24fab6557a5 req-1fb83403-74e2-483f-bf87-06a1b491dc13 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.279719 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-b01a7dfd-432c-4b78-807e-e24fab6557a5 req-1fb83403-74e2-483f-bf87-06a1b491dc13 service nova] Creating event network-changed:6c4ac575-82d3-4c88-90cb-0083321e1635 for instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 on hv-cinder-81969 Dec 07 18:47:08.295815 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-b01a7dfd-432c-4b78-807e-e24fab6557a5 req-1fb83403-74e2-483f-bf87-06a1b491dc13 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069635 Dec 07 18:47:08.297133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 230/434] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:08.329267 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:08.330398 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:08.343519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.349204 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.350439 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.355155 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.650302 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:08.659619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bdc89b3e-9d74-4dd8-ac52-a3f215dc71c5 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1757 microversion: 2.1 time: 0.543498 Dec 07 18:47:08.664690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:08.678748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 205/435] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:08 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1757 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:08.689018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-afdb4dcb-f5e5-4a50-8032-cb654ce6afdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1511 microversion: 2.1 time: 0.352054 Dec 07 18:47:08.701920 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 231/436] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:08 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1511 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:08.726078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:08.727598 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:08.743005 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.743724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:08.744869 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:08.745306 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:09.034467 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:09.035156 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:09.041880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:09.042609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:09.043544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:09.044210 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:09.056413 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:09.069028 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-629766bf-cf6c-4d51-a818-8ccc59561cce tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.346573 Dec 07 18:47:09.082066 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 206/437] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:08 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:09.201148 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:09.210054 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5065342d-ba59-4ef9-b720-8d3cca199627 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 200 len: 1515 microversion: 2.1 time: 0.180135 Dec 07 18:47:09.210634 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 232/438] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:09 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:09.237378 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9815b14e-19f3-4784-82ec-0d7069cfc0bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:09.239512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9815b14e-19f3-4784-82ec-0d7069cfc0bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:09.247639 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9815b14e-19f3-4784-82ec-0d7069cfc0bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:09.249594 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9815b14e-19f3-4784-82ec-0d7069cfc0bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:09.252937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9815b14e-19f3-4784-82ec-0d7069cfc0bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:09.253607 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9815b14e-19f3-4784-82ec-0d7069cfc0bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:09.466938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9815b14e-19f3-4784-82ec-0d7069cfc0bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29030 microversion: 2.20 time: 0.234349 Dec 07 18:47:09.467608 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 207/439] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:09 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29030 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:09.707841 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:09.708454 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:09.714685 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:09.715131 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:09.715894 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:09.716322 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:09.843174 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:09.850444 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-157a5840-b3bd-4385-9fc8-ec6c27c5d378 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1511 microversion: 2.1 time: 0.147057 Dec 07 18:47:09.851013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 233/440] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:09 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:10.087131 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:10.087819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:10.094885 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.095341 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.096130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.096566 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.228115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:10.228827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: fb71bb34-2f82-45de-91ba-98a927600c63] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:10.235773 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.236666 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.237697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.238568 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.246290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:10.257127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] HTTP exception thrown: Instance fb71bb34-2f82-45de-91ba-98a927600c63 could not be found. Dec 07 18:47:10.258198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0ecb9118-66bd-4044-af59-8f30ad4dc65c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.174873 Dec 07 18:47:10.258372 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Returning 404 to user: Instance fb71bb34-2f82-45de-91ba-98a927600c63 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:10.268471 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e6c83778-10ad-4871-b45f-9c5d81a18029 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63" status: 404 len: 111 microversion: 2.1 time: 0.035165 Dec 07 18:47:10.268471 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 234/441] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:10 2021] GET /compute/v2.1/servers/fb71bb34-2f82-45de-91ba-98a927600c63 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:47:10.271287 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 208/442] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:10 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:10.334343 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-4e7ecfd7-186b-4e5b-a486-c86ff2dc35ab req-87c46801-b940-4176-a20f-4e5e2bd2a71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb71bb34-2f82-45de-91ba-98a927600c63", "name": "network-vif-deleted", "tag": "74f8e1e0-b8b9-4c09-bd9a-f2532cc37bcf"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:10.335940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:10.335940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:10.342818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-4e7ecfd7-186b-4e5b-a486-c86ff2dc35ab req-87c46801-b940-4176-a20f-4e5e2bd2a71e service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.343505 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-4e7ecfd7-186b-4e5b-a486-c86ff2dc35ab req-87c46801-b940-4176-a20f-4e5e2bd2a71e service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.355617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-4e7ecfd7-186b-4e5b-a486-c86ff2dc35ab req-87c46801-b940-4176-a20f-4e5e2bd2a71e service nova] Creating event network-vif-deleted:74f8e1e0-b8b9-4c09-bd9a-f2532cc37bcf for instance fb71bb34-2f82-45de-91ba-98a927600c63 on hv-cinder-81969 Dec 07 18:47:10.367292 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-4e7ecfd7-186b-4e5b-a486-c86ff2dc35ab req-87c46801-b940-4176-a20f-4e5e2bd2a71e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036442 Dec 07 18:47:10.367909 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 235/443] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:10.479312 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6b554303-ba5f-4a18-949e-1801b9d9224f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:10.480237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6b554303-ba5f-4a18-949e-1801b9d9224f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:10.487164 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b554303-ba5f-4a18-949e-1801b9d9224f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.487611 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b554303-ba5f-4a18-949e-1801b9d9224f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.488392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b554303-ba5f-4a18-949e-1801b9d9224f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.488817 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b554303-ba5f-4a18-949e-1801b9d9224f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.676476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6b554303-ba5f-4a18-949e-1801b9d9224f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29030 microversion: 2.20 time: 0.200415 Dec 07 18:47:10.677366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 209/444] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:10 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29030 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:10.867654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:10.868340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:10.874308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.874748 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:10.875508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:10.875954 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.007781 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:11.014936 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a5d9c8ef-d1e4-4106-8f96-99eefe1dd8a1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1511 microversion: 2.1 time: 0.151682 Dec 07 18:47:11.015498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 236/445] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:10 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:11.277375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:11.278000 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:11.285074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.285529 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.286338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.286771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.392644 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:11.393217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:11.398983 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.399434 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.400203 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.400639 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.424184 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:11.425176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:47:11.433229 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-96812a40-5f41-4188-8a92-91bcd762b04b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.159869 Dec 07 18:47:11.433691 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 210/446] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:11 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:11.515777 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-452b04ac-6de4-4c75-b7f8-240659b2c11d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 204 len: 0 microversion: 2.1 time: 0.127076 Dec 07 18:47:11.516570 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 237/447] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:47:11 2021] DELETE /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 07 18:47:11.524498 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:11.525138 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:11.530999 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.531391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.532417 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.532839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.661010 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:11.668232 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-47d3da12-8218-42ac-83cb-369705c1cb4c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1515 microversion: 2.1 time: 0.147450 Dec 07 18:47:11.668791 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 211/448] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:11 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:11.689133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-12124696-2826-4f2a-9a81-1ad5fea453b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:11.690246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-12124696-2826-4f2a-9a81-1ad5fea453b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:11.696179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12124696-2826-4f2a-9a81-1ad5fea453b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.696616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12124696-2826-4f2a-9a81-1ad5fea453b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.697376 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12124696-2826-4f2a-9a81-1ad5fea453b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:11.697802 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12124696-2826-4f2a-9a81-1ad5fea453b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:11.784854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-12124696-2826-4f2a-9a81-1ad5fea453b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29030 microversion: 2.20 time: 0.100088 Dec 07 18:47:11.785599 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 238/449] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:11 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29030 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:12.032993 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:12.033562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:12.039905 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.040284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.041040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.041465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.178633 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:12.185781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f4586ce9-8c32-4efb-8654-ba93527ebd0d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1517 microversion: 2.1 time: 0.156968 Dec 07 18:47:12.186378 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 212/450] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:12 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:12.452346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:12.453040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:12.460443 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.460889 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.461657 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.462127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.591952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:12.600383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e0370e8f-3ebe-448a-941a-0e9f6e7ed1ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.152085 Dec 07 18:47:12.600945 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 239/451] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:12 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:12.686147 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:12.686750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:12.694465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.694948 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.695767 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.696237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.796230 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-935a4249-c2bf-4c5a-849f-050e007fd3d8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:12.797122 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-935a4249-c2bf-4c5a-849f-050e007fd3d8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:12.803791 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-935a4249-c2bf-4c5a-849f-050e007fd3d8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.804234 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-935a4249-c2bf-4c5a-849f-050e007fd3d8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.805017 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-935a4249-c2bf-4c5a-849f-050e007fd3d8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:12.805452 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-935a4249-c2bf-4c5a-849f-050e007fd3d8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:12.828759 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:12.836612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-010f00f2-c1ed-4fda-b76a-9e9fd7abff7c tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1515 microversion: 2.1 time: 0.154210 Dec 07 18:47:12.837180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 213/452] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:12 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:12.902854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-935a4249-c2bf-4c5a-849f-050e007fd3d8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29030 microversion: 2.20 time: 0.110185 Dec 07 18:47:12.903482 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 240/453] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:12 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29030 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:47:13.417966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:13.418563 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:13.424653 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.425111 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.425937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.426737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.561733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:13.569822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c5df90c8-b52e-478d-aa9b-6e8eb1548b1c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1517 microversion: 2.1 time: 0.155395 Dec 07 18:47:13.570423 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 214/454] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:13 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:13.587448 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-461d4977-b663-42e9-b0e0-a615ed9ae7fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f72751-905d-485c-90c0-64e76977f5cc"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:13.588571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-461d4977-b663-42e9-b0e0-a615ed9ae7fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:13.595318 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-461d4977-b663-42e9-b0e0-a615ed9ae7fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.595753 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-461d4977-b663-42e9-b0e0-a615ed9ae7fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.596508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-461d4977-b663-42e9-b0e0-a615ed9ae7fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.596935 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-461d4977-b663-42e9-b0e0-a615ed9ae7fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.617247 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:13.617851 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:13.623581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.623966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.624775 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.625170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.761804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:13.770413 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8c07eea1-3fa4-4369-b746-f0b18637285d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.156747 Dec 07 18:47:13.770978 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 215/455] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:13 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:13.835650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-461d4977-b663-42e9-b0e0-a615ed9ae7fc tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252111 Dec 07 18:47:13.836254 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 241/456] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:47:13 2021] POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:47:13.855713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:13.856664 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:13.865269 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.865728 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.866547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.866984 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.915173 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6616d7f8-21fe-42d8-a185-e87b711d066b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:13.916218 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6616d7f8-21fe-42d8-a185-e87b711d066b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:13.923795 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6616d7f8-21fe-42d8-a185-e87b711d066b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.923977 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6616d7f8-21fe-42d8-a185-e87b711d066b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:13.924695 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6616d7f8-21fe-42d8-a185-e87b711d066b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:13.925120 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6616d7f8-21fe-42d8-a185-e87b711d066b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:14.005277 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:14.006901 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6616d7f8-21fe-42d8-a185-e87b711d066b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29030 microversion: 2.20 time: 0.095704 Dec 07 18:47:14.007666 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 242/457] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:13 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29030 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:14.012925 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b4d8e904-7dd9-4e74-b274-593ea381aa5e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1515 microversion: 2.1 time: 0.162852 Dec 07 18:47:14.013472 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 216/458] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:13 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:14.787875 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:14.788579 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:14.789818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-1139d68a-1838-4c4d-a5ac-374c9462e1fc req-8f55dbdc-4ec6-4fcb-8bf6-65718dc50101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd63ffe-4565-42f6-8f7c-9f83cda248e8", "name": "network-vif-deleted", "tag": "1b17425e-406c-49a0-9e23-08dbf104898d"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:14.791870 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:14.791870 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:14.794972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:14.795422 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:14.796242 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:14.796646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:14.807746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-1139d68a-1838-4c4d-a5ac-374c9462e1fc req-8f55dbdc-4ec6-4fcb-8bf6-65718dc50101 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:14.808187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-1139d68a-1838-4c4d-a5ac-374c9462e1fc req-8f55dbdc-4ec6-4fcb-8bf6-65718dc50101 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:14.823332 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-1139d68a-1838-4c4d-a5ac-374c9462e1fc req-8f55dbdc-4ec6-4fcb-8bf6-65718dc50101 service nova] Creating event network-vif-deleted:1b17425e-406c-49a0-9e23-08dbf104898d for instance 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 on hv-cinder-81969 Dec 07 18:47:14.829078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-1139d68a-1838-4c4d-a5ac-374c9462e1fc req-8f55dbdc-4ec6-4fcb-8bf6-65718dc50101 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044258 Dec 07 18:47:14.829934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 243/459] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:14.944603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:14.952883 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7b4f4552-2d47-4a52-92c5-51768bc84a8a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1725 microversion: 2.1 time: 0.168573 Dec 07 18:47:14.953444 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 217/460] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:14 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:15.019074 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9a19ba8f-5d1d-4e4a-9867-71a4fa1e52f4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:15.020052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9a19ba8f-5d1d-4e4a-9867-71a4fa1e52f4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:15.026101 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9a19ba8f-5d1d-4e4a-9867-71a4fa1e52f4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:15.026544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9a19ba8f-5d1d-4e4a-9867-71a4fa1e52f4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:15.027301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9a19ba8f-5d1d-4e4a-9867-71a4fa1e52f4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:15.027725 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9a19ba8f-5d1d-4e4a-9867-71a4fa1e52f4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:15.030416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:15.031045 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:15.037252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:15.037696 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:15.038507 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:15.038938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:15.068859 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:15.069313 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:15.069756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lazy-loading 'fault' on Instance uuid 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:47:15.112563 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:15.115212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9a19ba8f-5d1d-4e4a-9867-71a4fa1e52f4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29030 microversion: 2.20 time: 0.100478 Dec 07 18:47:15.115894 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 244/461] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:15 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29030 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:15.122544 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ebdef00a-3fc6-4c27-8f95-ec8874e5a678 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 200 len: 1308 microversion: 2.1 time: 0.095691 Dec 07 18:47:15.123108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 218/462] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:15 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:15.971025 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:15.971721 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:15.978737 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:15.979187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:15.979963 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:15.980395 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.117107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:16.124855 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a02bb1f9-6696-4738-936f-a8099b6f7968 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1702 microversion: 2.1 time: 0.157936 Dec 07 18:47:16.125411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 245/463] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:15 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1702 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:16.126508 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ecddf29d-81fe-42a2-8ee7-7ebe369806bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:16.127491 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ecddf29d-81fe-42a2-8ee7-7ebe369806bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:16.133737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecddf29d-81fe-42a2-8ee7-7ebe369806bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.134344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecddf29d-81fe-42a2-8ee7-7ebe369806bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.135185 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecddf29d-81fe-42a2-8ee7-7ebe369806bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.135717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ecddf29d-81fe-42a2-8ee7-7ebe369806bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.139190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:16.140123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 5fd63ffe-4565-42f6-8f7c-9f83cda248e8] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:16.146565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.147009 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.147789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.148222 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.162967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] HTTP exception thrown: Instance 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 could not be found. Dec 07 18:47:16.163554 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Returning 404 to user: Instance 5fd63ffe-4565-42f6-8f7c-9f83cda248e8 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:16.164379 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5f3481cd-abb5-4228-963a-920ad919eaf5 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8" status: 404 len: 111 microversion: 2.1 time: 0.029063 Dec 07 18:47:16.164925 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 246/464] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:16 2021] GET /compute/v2.1/servers/5fd63ffe-4565-42f6-8f7c-9f83cda248e8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:47:16.169462 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-abcd901d-9805-4363-9d78-416e7cc796a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:16.175720 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abcd901d-9805-4363-9d78-416e7cc796a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.176438 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abcd901d-9805-4363-9d78-416e7cc796a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.207072 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ecddf29d-81fe-42a2-8ee7-7ebe369806bf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29030 microversion: 2.20 time: 0.084565 Dec 07 18:47:16.211697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 219/465] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:16 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29030 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:47:16.213476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:16.214075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:16.221262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.221704 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.222504 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.222935 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.234127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-abcd901d-9805-4363-9d78-416e7cc796a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Going to try to start instance {{(pid=122585) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 07 18:47:16.248238 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:47:16.275549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-abcd901d-9805-4363-9d78-416e7cc796a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 202 len: 0 microversion: 2.1 time: 0.109463 Dec 07 18:47:16.276146 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 247/466] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:47:16 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:16.284510 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:16.285192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:16.291409 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.291881 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.292663 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.293220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.343216 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f0236ab5-62c9-409a-9998-8387cc841cc2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "DELETE /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 204 len: 0 microversion: 2.1 time: 0.132792 Dec 07 18:47:16.344804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 220/467] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:47:16 2021] DELETE /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:47:16.354156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:16.355335 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:16.362577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.363559 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.364512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:16.365126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:16.451740 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:16.459875 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0a4267b4-b901-45cc-81f2-375211c7e1a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1711 microversion: 2.1 time: 0.179297 Dec 07 18:47:16.460451 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 248/468] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:16 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1711 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:16.590012 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:16.597999 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-29de35ca-c9d9-4f6f-8444-224f3d797ec6 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1513 microversion: 2.1 time: 0.248486 Dec 07 18:47:16.598504 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 221/469] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:16 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:17.219689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3909decc-cc50-4873-89e5-3b4e4df7ec3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:17.220887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3909decc-cc50-4873-89e5-3b4e4df7ec3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:17.227282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3909decc-cc50-4873-89e5-3b4e4df7ec3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:17.227715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3909decc-cc50-4873-89e5-3b4e4df7ec3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:17.228489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3909decc-cc50-4873-89e5-3b4e4df7ec3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:17.228915 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3909decc-cc50-4873-89e5-3b4e4df7ec3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:17.318161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3909decc-cc50-4873-89e5-3b4e4df7ec3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 29923 microversion: 2.20 time: 0.102101 Dec 07 18:47:17.318721 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 249/470] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:17 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 29923 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:17.477787 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:17.478408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:17.484616 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:17.485603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:17.486526 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:17.486950 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:17.614032 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:17.616340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:17.617176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:17.624003 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:17.624448 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:17.625215 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:17.625346 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a0f10909-2e36-4c87-af2a-6ba69b16fc43 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1711 microversion: 2.1 time: 0.150885 Dec 07 18:47:17.626862 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 222/471] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:17 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1711 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:17.627019 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:17.762104 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:17.769608 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5ce12c64-8734-471c-b9bd-e3bd0fa11791 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1513 microversion: 2.1 time: 0.157297 Dec 07 18:47:17.770191 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 250/472] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:17 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:18.330396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1f848b7a-5089-4e33-8d7b-c64814e98c03 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:18.331282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1f848b7a-5089-4e33-8d7b-c64814e98c03 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:18.337435 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f848b7a-5089-4e33-8d7b-c64814e98c03 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:18.337870 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f848b7a-5089-4e33-8d7b-c64814e98c03 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:18.338660 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f848b7a-5089-4e33-8d7b-c64814e98c03 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:18.339085 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f848b7a-5089-4e33-8d7b-c64814e98c03 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:18.440316 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1f848b7a-5089-4e33-8d7b-c64814e98c03 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 30958 microversion: 2.20 time: 0.114150 Dec 07 18:47:18.440995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 223/473] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:18 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 30958 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:18.644409 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:18.645015 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:18.651368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:18.651816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:18.652583 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:18.653010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:18.786242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:18.792274 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:18.793498 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:18.795798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-35a8bfb1-db00-4027-a5d7-61b376b032b3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1715 microversion: 2.1 time: 0.155764 Dec 07 18:47:18.796697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 251/474] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:18 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:18.800089 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:18.800542 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:18.801595 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:18.802060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:18.995633 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-7362129b-6e9a-4198-804f-0ed31b9f9262 req-a9ea1bf8-5985-467f-b9f2-29f3b96a6e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e2d7c4-b135-4871-9753-659f8c3cfaf1", "name": "network-vif-deleted", "tag": "b08af1cd-2e39-4c70-8061-c097c902fc64"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:18.997642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:18.997642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:19.008616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-7362129b-6e9a-4198-804f-0ed31b9f9262 req-a9ea1bf8-5985-467f-b9f2-29f3b96a6e55 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:19.009065 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-7362129b-6e9a-4198-804f-0ed31b9f9262 req-a9ea1bf8-5985-467f-b9f2-29f3b96a6e55 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:19.022060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-7362129b-6e9a-4198-804f-0ed31b9f9262 req-a9ea1bf8-5985-467f-b9f2-29f3b96a6e55 service nova] Creating event network-vif-deleted:b08af1cd-2e39-4c70-8061-c097c902fc64 for instance 15e2d7c4-b135-4871-9753-659f8c3cfaf1 on hv-cinder-81969 Dec 07 18:47:19.024065 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:19.028806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-7362129b-6e9a-4198-804f-0ed31b9f9262 req-a9ea1bf8-5985-467f-b9f2-29f3b96a6e55 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037022 Dec 07 18:47:19.029414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 252/475] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:47:19.033902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-46352af4-6c62-4f83-bada-d16e226e9ca2 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 200 len: 1513 microversion: 2.1 time: 0.251004 Dec 07 18:47:19.034707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 224/476] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:18 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:19.451302 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-87a1afd1-0c43-4b33-98e2-b5dc7bd3ff92 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:19.452509 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-87a1afd1-0c43-4b33-98e2-b5dc7bd3ff92 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:19.459935 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a1afd1-0c43-4b33-98e2-b5dc7bd3ff92 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:19.460421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a1afd1-0c43-4b33-98e2-b5dc7bd3ff92 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:19.461203 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a1afd1-0c43-4b33-98e2-b5dc7bd3ff92 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:19.461636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a1afd1-0c43-4b33-98e2-b5dc7bd3ff92 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:19.553293 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-87a1afd1-0c43-4b33-98e2-b5dc7bd3ff92 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 32414 microversion: 2.20 time: 0.105627 Dec 07 18:47:19.554584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 253/477] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:19 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 32414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:20.051824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:20.052355 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 15e2d7c4-b135-4871-9753-659f8c3cfaf1] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:20.058547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:20.065283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:20.065283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:20.065283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:20.074051 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] HTTP exception thrown: Instance 15e2d7c4-b135-4871-9753-659f8c3cfaf1 could not be found. Dec 07 18:47:20.074646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Returning 404 to user: Instance 15e2d7c4-b135-4871-9753-659f8c3cfaf1 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:20.075463 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b5d93b3b-ec09-4ea8-9318-314032fe93c1 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1" status: 404 len: 111 microversion: 2.1 time: 0.027778 Dec 07 18:47:20.076007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 225/478] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:20 2021] GET /compute/v2.1/servers/15e2d7c4-b135-4871-9753-659f8c3cfaf1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:47:20.567371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-25876dce-72dd-4f14-9db4-d63153d9549e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:20.568498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-25876dce-72dd-4f14-9db4-d63153d9549e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:20.577103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25876dce-72dd-4f14-9db4-d63153d9549e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:20.577875 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25876dce-72dd-4f14-9db4-d63153d9549e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:20.578814 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25876dce-72dd-4f14-9db4-d63153d9549e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:20.579373 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25876dce-72dd-4f14-9db4-d63153d9549e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:20.671951 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-25876dce-72dd-4f14-9db4-d63153d9549e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 33424 microversion: 2.20 time: 0.110493 Dec 07 18:47:20.673183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 254/479] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:20 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 33424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:21.212274 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:21.212764 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:21.219896 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.220253 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.220963 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.221391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.245779 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:47:21.321015 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:21.322135 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:21.329586 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.330216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.331082 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.331529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.335873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7f158227-beed-4d01-b955-f20f20cffc1d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "DELETE /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 204 len: 0 microversion: 2.1 time: 0.126255 Dec 07 18:47:21.336035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 226/480] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:47:21 2021] DELETE /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:47:21.345074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:21.345775 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:21.351521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.351949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.352729 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.353157 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.358854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lazy-loading 'flavor' on Instance uuid a5651cc9-ef23-4b3a-bfc6-dd832eaec69f {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:47:21.481820 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-91b1a8f6-ab18-465d-a0c0-7d49be3c6199 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action" status: 200 len: 32 microversion: 2.1 time: 0.164865 Dec 07 18:47:21.482662 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 255/481] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:47:21 2021] POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 07 18:47:21.491612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:21.492300 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:21.493590 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:21.501857 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9a53bbb5-0444-41e8-b459-ac089ebad65e tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1515 microversion: 2.1 time: 0.160698 Dec 07 18:47:21.502084 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.502354 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.502811 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 227/482] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:21 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:21.503164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.503556 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.637553 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:21.647311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5e531320-9385-4461-a131-6bad2fe6956e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.159494 Dec 07 18:47:21.648103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 256/483] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:21 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:21.684561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6d2ccb29-e9ef-4752-a536-982b71070924 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:21.685466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6d2ccb29-e9ef-4752-a536-982b71070924 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:21.692884 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d2ccb29-e9ef-4752-a536-982b71070924 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.693796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d2ccb29-e9ef-4752-a536-982b71070924 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.694714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d2ccb29-e9ef-4752-a536-982b71070924 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:21.695153 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d2ccb29-e9ef-4752-a536-982b71070924 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:21.810440 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6d2ccb29-e9ef-4752-a536-982b71070924 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 33961 microversion: 2.20 time: 0.129294 Dec 07 18:47:21.813875 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 228/484] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:21 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 33961 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:22.519858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:22.520454 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:22.526580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:22.527018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:22.527773 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:22.528194 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:22.660019 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:22.664867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:22.665581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:22.667281 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7b60cdce-0272-4a00-ba22-c4936c674720 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1515 microversion: 2.1 time: 0.152005 Dec 07 18:47:22.667883 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 257/485] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:22 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:22.673565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:22.674074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:22.674863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:22.675299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:22.811018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:22.822869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-12893483-4d8b-4e5a-9df2-2efea31ec3e5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:22.823075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4b4300e4-3199-4059-83fc-cbdf834a79ac tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.161929 Dec 07 18:47:22.823439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 229/486] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:22 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:22.823819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-12893483-4d8b-4e5a-9df2-2efea31ec3e5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:22.830172 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12893483-4d8b-4e5a-9df2-2efea31ec3e5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:22.830626 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12893483-4d8b-4e5a-9df2-2efea31ec3e5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:22.831388 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12893483-4d8b-4e5a-9df2-2efea31ec3e5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:22.831810 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12893483-4d8b-4e5a-9df2-2efea31ec3e5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:22.928516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-12893483-4d8b-4e5a-9df2-2efea31ec3e5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 34407 microversion: 2.20 time: 0.109163 Dec 07 18:47:22.929142 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 258/487] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:22 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 34407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:47:23.684556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:23.685071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:23.691647 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:23.692097 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:23.692873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:23.693300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:23.839603 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:23.840300 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:23.847328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:23.847777 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:23.848561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:23.848990 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:23.920096 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be5301c42eaa4538800ccab20dfc9b7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12e59e340c3845b199cb2b187d625932', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:23.930375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-eab1e58c-6dbd-46c0-b007-ef3ace479744 tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 200 len: 1515 microversion: 2.1 time: 0.249425 Dec 07 18:47:23.931178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 230/488] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:23 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:23.946939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5732fc0b-d5d4-46d7-af71-b8edf113aa11 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:23.947936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5732fc0b-d5d4-46d7-af71-b8edf113aa11 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:23.955746 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5732fc0b-d5d4-46d7-af71-b8edf113aa11 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:23.956019 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5732fc0b-d5d4-46d7-af71-b8edf113aa11 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:23.956845 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5732fc0b-d5d4-46d7-af71-b8edf113aa11 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:23.957282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5732fc0b-d5d4-46d7-af71-b8edf113aa11 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:23.985926 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:23.993571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ec8f0e49-59c5-4d77-8bf1-ce7e55deda6f tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.157935 Dec 07 18:47:23.994173 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 259/489] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:23 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:24.048916 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5732fc0b-d5d4-46d7-af71-b8edf113aa11 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 35133 microversion: 2.20 time: 0.105201 Dec 07 18:47:24.049547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 231/490] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:23 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 35133 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:24.138604 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-1eace1bb-fb0d-4dd7-b26d-e21795d0373a req-4efe3a64-7f45-4634-b340-f59b0ef6fee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "227d00ae-26f9-4f9d-8aa8-87aa48f24b6d", "name": "network-vif-deleted", "tag": "3a78c11c-a38a-41c4-8b8d-2c6c97e8cf2a"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:24.141525 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:24.141525 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:47:24.149428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-1eace1bb-fb0d-4dd7-b26d-e21795d0373a req-4efe3a64-7f45-4634-b340-f59b0ef6fee0 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:24.149958 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-1eace1bb-fb0d-4dd7-b26d-e21795d0373a req-4efe3a64-7f45-4634-b340-f59b0ef6fee0 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:24.161762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-1eace1bb-fb0d-4dd7-b26d-e21795d0373a req-4efe3a64-7f45-4634-b340-f59b0ef6fee0 service nova] Creating event network-vif-deleted:3a78c11c-a38a-41c4-8b8d-2c6c97e8cf2a for instance 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d on hv-cinder-81969 Dec 07 18:47:24.166560 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-1eace1bb-fb0d-4dd7-b26d-e21795d0373a req-4efe3a64-7f45-4634-b340-f59b0ef6fee0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 Dec 07 18:47:24.167334 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 260/491] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:24.950163 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:24.950863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] [instance: 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:24.958709 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:24.959091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:24.959856 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:24.960284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:24.974533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] HTTP exception thrown: Instance 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d could not be found. Dec 07 18:47:24.975104 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] Returning 404 to user: Instance 227d00ae-26f9-4f9d-8aa8-87aa48f24b6d could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:24.975905 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d1fa9aec-3c82-42bc-ab91-8db76595363d tempest-AttachVolumeNegativeTest-1175657783 tempest-AttachVolumeNegativeTest-1175657783-project] 10.222.0.41 "GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d" status: 404 len: 111 microversion: 2.1 time: 0.029899 Dec 07 18:47:24.976422 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 232/492] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:24 2021] GET /compute/v2.1/servers/227d00ae-26f9-4f9d-8aa8-87aa48f24b6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:47:25.012070 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:25.012760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:25.019738 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:25.020183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:25.020958 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:25.021390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:25.061596 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5254cac6-bb60-4acb-b725-d792c6a178e4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:25.062560 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5254cac6-bb60-4acb-b725-d792c6a178e4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:25.069439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5254cac6-bb60-4acb-b725-d792c6a178e4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:25.069899 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5254cac6-bb60-4acb-b725-d792c6a178e4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:25.070705 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5254cac6-bb60-4acb-b725-d792c6a178e4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:25.071139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5254cac6-bb60-4acb-b725-d792c6a178e4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:25.156079 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5254cac6-bb60-4acb-b725-d792c6a178e4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 37098 microversion: 2.20 time: 0.097785 Dec 07 18:47:25.157589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 233/493] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:25 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 37098 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:25.163186 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:25.172204 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0a48a1c4-349b-423d-8131-b15f3c2df278 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.164439 Dec 07 18:47:25.172921 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 261/494] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:25 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:26.170018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4fdfe5b2-4bce-4708-85f6-038e8ba71f97 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:26.171027 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4fdfe5b2-4bce-4708-85f6-038e8ba71f97 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:26.179108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4fdfe5b2-4bce-4708-85f6-038e8ba71f97 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:26.179906 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4fdfe5b2-4bce-4708-85f6-038e8ba71f97 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:26.180697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4fdfe5b2-4bce-4708-85f6-038e8ba71f97 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:26.181157 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4fdfe5b2-4bce-4708-85f6-038e8ba71f97 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:26.189607 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:26.190736 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:26.197053 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:26.197514 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:26.198776 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:26.198776 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:26.265703 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4fdfe5b2-4bce-4708-85f6-038e8ba71f97 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 38144 microversion: 2.20 time: 0.099475 Dec 07 18:47:26.269748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 234/495] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:26 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 38144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:26.343670 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:26.351871 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-78f53964-3d8f-4961-ae8a-59fc358787e0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.166063 Dec 07 18:47:26.352627 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 262/496] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:26 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:26.711340 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1c206b2c-1b62-410a-949f-d28d4140e057 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Action: 'create', calling method: .version_select at 0x7f19981fd700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-598588255"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:26.885088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1c206b2c-1b62-410a-949f-d28d4140e057 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.298444 Dec 07 18:47:26.885713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 235/497] 10.222.0.41 () {60 vars in 1154 bytes} [Tue Dec 7 18:47:26 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 300 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 07 18:47:26.897417 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7588806a-7429-49ac-94f7-a80b90d76a60 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19980cc940>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:26.944302 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7588806a-7429-49ac-94f7-a80b90d76a60 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47" status: 200 len: 344 microversion: 2.1 time: 0.050416 Dec 07 18:47:26.944873 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 263/498] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:47:26 2021] GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:27.276919 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0805a1fd-85d6-47b1-a0be-26852db8366a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:27.277940 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0805a1fd-85d6-47b1-a0be-26852db8366a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:27.284678 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0805a1fd-85d6-47b1-a0be-26852db8366a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:27.285122 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0805a1fd-85d6-47b1-a0be-26852db8366a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:27.285888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0805a1fd-85d6-47b1-a0be-26852db8366a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:27.286332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0805a1fd-85d6-47b1-a0be-26852db8366a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:27.370242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:27.370845 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:27.376555 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0805a1fd-85d6-47b1-a0be-26852db8366a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 38536 microversion: 2.20 time: 0.103597 Dec 07 18:47:27.377469 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 236/499] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:27 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 38536 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:47:27.377610 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:27.377810 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:27.378618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:27.379051 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:27.518195 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:27.525812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c6e641ca-6022-4864-9e0a-bf66f7bbb56b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.159658 Dec 07 18:47:27.526406 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 264/500] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:27 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:27.957310 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a3d4f113-3590-454a-85b4-50bba4fedeac tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f1998200f70>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:28.002533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a3d4f113-3590-454a-85b4-50bba4fedeac tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47" status: 200 len: 345 microversion: 2.1 time: 0.049121 Dec 07 18:47:28.003131 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 237/501] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:47:27 2021] GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:28.014228 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ea64f553-d36e-433e-b384-274972ca6009 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Action: 'create', calling method: .version_select at 0x7f19980ccaf0>, body: {"snapshot": {"volume_id": "0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1872336790"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:28.099539 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ea64f553-d36e-433e-b384-274972ca6009 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.088909 Dec 07 18:47:28.100125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 265/502] 10.222.0.41 () {60 vars in 1161 bytes} [Tue Dec 7 18:47:28 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:28.111154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-fe061b5f-b6a4-4056-9e4e-dc93e055613c tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f1998281160>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:28.141145 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-fe061b5f-b6a4-4056-9e4e-dc93e055613c tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 200 len: 287 microversion: 2.1 time: 0.035143 Dec 07 18:47:28.142154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 238/503] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:28 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:28.152389 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-acd218bd-ddb9-4afb-9874-01c25bb47ea5 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19980a05e0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:28.191985 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-acd218bd-ddb9-4afb-9874-01c25bb47ea5 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.043088 Dec 07 18:47:28.192553 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 266/504] 10.222.0.41 () {58 vars in 1139 bytes} [Tue Dec 7 18:47:28 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:47:28.202617 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-66791d62-53e8-42e2-b67b-fba8ab3d25d6 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19983f7af0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:28.230348 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-66791d62-53e8-42e2-b67b-fba8ab3d25d6 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 200 len: 287 microversion: 2.1 time: 0.031633 Dec 07 18:47:28.230923 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 239/505] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:28 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:28.390428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d8fbb0cd-8e15-486b-b62f-3160a90aaa5f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:28.392460 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d8fbb0cd-8e15-486b-b62f-3160a90aaa5f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:28.398543 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8fbb0cd-8e15-486b-b62f-3160a90aaa5f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:28.398990 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8fbb0cd-8e15-486b-b62f-3160a90aaa5f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:28.399748 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8fbb0cd-8e15-486b-b62f-3160a90aaa5f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:28.400212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d8fbb0cd-8e15-486b-b62f-3160a90aaa5f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:28.542861 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:28.543571 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:28.550354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:28.551050 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:28.551820 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:28.552255 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:28.683902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:28.692173 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2a428476-2dc1-4bd7-9a92-84747c4e0af9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.153461 Dec 07 18:47:28.692737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 240/506] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:28 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:29.242024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9727ea5b-71b4-4962-ac04-d74438b73d80 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f1998281ca0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:29.271529 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9727ea5b-71b4-4962-ac04-d74438b73d80 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 200 len: 287 microversion: 2.1 time: 0.033133 Dec 07 18:47:29.272089 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 241/507] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:29 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:47:29.709547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:29.710216 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:29.716122 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:29.716562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:29.717347 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:29.717772 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:29.847431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:29.855130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b4a8090c-5c15-4ba2-be40-a0b21dce89d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.149294 Dec 07 18:47:29.855787 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 242/508] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:29 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:30.283400 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c0c42a4f-0ef4-445a-ac6f-b6f33bde3a65 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19983f79d0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:30.312300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c0c42a4f-0ef4-445a-ac6f-b6f33bde3a65 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 200 len: 287 microversion: 2.1 time: 0.032990 Dec 07 18:47:30.312886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 243/509] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:30 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:30.872878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:30.873535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:30.880265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:30.880707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:30.881508 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:30.881954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:31.014157 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:31.021831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-64bcbc0e-4e68-44e3-b621-adfbc706d7b9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.153058 Dec 07 18:47:31.022423 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 244/510] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:30 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:31.226687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d8fbb0cd-8e15-486b-b62f-3160a90aaa5f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 38536 microversion: 2.20 time: 2.840336 Dec 07 18:47:31.227340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 267/511] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:28 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 38536 bytes in 2842 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:31.323857 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0ed70d46-1efc-4d9c-b568-8ed21ecef1b2 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f1998240b80>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:31.352875 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0ed70d46-1efc-4d9c-b568-8ed21ecef1b2 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 200 len: 287 microversion: 2.1 time: 0.032693 Dec 07 18:47:31.353452 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 245/512] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:31 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:32.039175 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:32.039863 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:32.046700 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:32.047144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:32.048400 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:32.048831 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:32.240426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0b0e8c31-1f14-4047-8e4f-087c58b3802a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:32.241432 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0b0e8c31-1f14-4047-8e4f-087c58b3802a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:32.248405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b0e8c31-1f14-4047-8e4f-087c58b3802a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:32.248861 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b0e8c31-1f14-4047-8e4f-087c58b3802a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:32.249651 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b0e8c31-1f14-4047-8e4f-087c58b3802a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:32.250203 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b0e8c31-1f14-4047-8e4f-087c58b3802a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:32.331273 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0b0e8c31-1f14-4047-8e4f-087c58b3802a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 38540 microversion: 2.20 time: 0.095741 Dec 07 18:47:32.335721 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 246/513] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:32 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 38540 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:47:32.365207 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0d40e570-3576-42c8-8540-302888b44b05 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19982404c0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:32.396691 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0d40e570-3576-42c8-8540-302888b44b05 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 200 len: 288 microversion: 2.1 time: 0.035442 Dec 07 18:47:32.397894 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 247/514] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:32 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:47:32.407820 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:32.408387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7b4ee2b5-dc50-4d84-a23a-2d2b0de81c31 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f1998281670>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:32.415884 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d466adf4-4d57-4df1-94b0-becb3da5cb8e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.380515 Dec 07 18:47:32.417394 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 268/515] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:32 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:32.465040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7b4ee2b5-dc50-4d84-a23a-2d2b0de81c31 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 202 len: 0 microversion: 2.1 time: 0.061029 Dec 07 18:47:32.465612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 248/516] 10.222.0.41 () {58 vars in 1253 bytes} [Tue Dec 7 18:47:32 2021] DELETE /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:47:32.473432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b76408f8-d9da-4fb6-a236-b7f3c382db6e tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f199807a9d0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:32.503165 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b76408f8-d9da-4fb6-a236-b7f3c382db6e tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 200 len: 287 microversion: 2.1 time: 0.033231 Dec 07 18:47:32.503720 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 269/517] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:32 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:33.343962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8f202bb3-d016-42f8-9604-234066316ddb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:33.345007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8f202bb3-d016-42f8-9604-234066316ddb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:33.351209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f202bb3-d016-42f8-9604-234066316ddb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:33.351654 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f202bb3-d016-42f8-9604-234066316ddb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:33.352422 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f202bb3-d016-42f8-9604-234066316ddb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:33.352847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f202bb3-d016-42f8-9604-234066316ddb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:33.433828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:33.434458 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:33.434699 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8f202bb3-d016-42f8-9604-234066316ddb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 200 len: 38679 microversion: 2.20 time: 0.094748 Dec 07 18:47:33.435492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 249/518] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:33 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 38679 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:33.445034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:33.445477 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:33.446279 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:33.446422 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-97be301d-dfea-498b-bfff-ff6644dfc715 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:33.446850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:33.446972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-97be301d-dfea-498b-bfff-ff6644dfc715 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:33.453675 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97be301d-dfea-498b-bfff-ff6644dfc715 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:33.454174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97be301d-dfea-498b-bfff-ff6644dfc715 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:33.455268 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97be301d-dfea-498b-bfff-ff6644dfc715 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:33.455788 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97be301d-dfea-498b-bfff-ff6644dfc715 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:33.482024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-97be301d-dfea-498b-bfff-ff6644dfc715 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/ips" status: 200 len: 152 microversion: 2.20 time: 0.039722 Dec 07 18:47:33.482873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 250/519] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Dec 7 18:47:33 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:47:33.514679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f9a534d5-774a-4fae-a28b-8f710951b3a4 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f199840a0d0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:33.541261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-f9a534d5-774a-4fae-a28b-8f710951b3a4 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] HTTP exception thrown: Snapshot 2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 could not be found. Dec 07 18:47:33.542145 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f9a534d5-774a-4fae-a28b-8f710951b3a4 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Returning 404 to user: Snapshot 2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:33.543450 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f9a534d5-774a-4fae-a28b-8f710951b3a4 tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6" status: 404 len: 111 microversion: 2.1 time: 0.032061 Dec 07 18:47:33.543963 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 251/520] 10.222.0.41 () {58 vars in 1250 bytes} [Tue Dec 7 18:47:33 2021] GET /compute/v2.1/os-snapshots/2ac0a17e-41d3-44e4-ae29-4b9baf0664b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:47:33.551962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-fa57514c-395c-4080-978e-bee06f6b30bd tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19981e5310>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:33.586355 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:33.595069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8e42f8e4-5fb7-4280-b437-932f834c6d7e tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.164724 Dec 07 18:47:33.595772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 270/521] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:33 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:33.633402 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-fa57514c-395c-4080-978e-bee06f6b30bd tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47" status: 202 len: 0 microversion: 2.1 time: 0.085239 Dec 07 18:47:33.634539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 252/522] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Dec 7 18:47:33 2021] DELETE /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:33.643363 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0023ddeb-6fa8-45b6-8ac3-a953dbc4d86c tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19981425e0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:33.693661 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0023ddeb-6fa8-45b6-8ac3-a953dbc4d86c tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47" status: 200 len: 344 microversion: 2.1 time: 0.054753 Dec 07 18:47:33.694336 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 271/523] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:47:33 2021] GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:34.613492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:34.614128 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:34.620008 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:34.620463 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:34.621239 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:34.621675 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:34.707186 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-68bd1d9e-61e4-4081-984c-07ff8f66ed5e tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f19980b9280>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:34.736945 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-68bd1d9e-61e4-4081-984c-07ff8f66ed5e tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] HTTP exception thrown: Volume 0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 could not be found. Dec 07 18:47:34.737690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-68bd1d9e-61e4-4081-984c-07ff8f66ed5e tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Returning 404 to user: Volume 0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:34.738660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-68bd1d9e-61e4-4081-984c-07ff8f66ed5e tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47" status: 404 len: 109 microversion: 2.1 time: 0.036241 Dec 07 18:47:34.739317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 272/524] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:47:34 2021] GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:47:34.755136 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-75c32b6c-ff3e-4155-bc0e-ea63213994ad tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f1998c308b0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:34.760014 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:34.768023 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d4429ff7-528e-4444-bc87-fdedf6bf6b0c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.159216 Dec 07 18:47:34.768584 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 253/525] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:34 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:34.782665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-75c32b6c-ff3e-4155-bc0e-ea63213994ad tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] HTTP exception thrown: Volume 0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 could not be found. Dec 07 18:47:34.783364 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-75c32b6c-ff3e-4155-bc0e-ea63213994ad tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Returning 404 to user: Volume 0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:34.784225 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-75c32b6c-ff3e-4155-bc0e-ea63213994ad tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47" status: 404 len: 109 microversion: 2.1 time: 0.032764 Dec 07 18:47:34.784766 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 273/526] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Dec 7 18:47:34 2021] DELETE /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:47:34.792235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c4bfe399-8c88-4e57-90ba-604ecd0caa2f tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Calling method '.version_select at 0x7f1998282430>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:34.819748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-c4bfe399-8c88-4e57-90ba-604ecd0caa2f tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] HTTP exception thrown: Volume 0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 could not be found. Dec 07 18:47:34.820337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c4bfe399-8c88-4e57-90ba-604ecd0caa2f tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] Returning 404 to user: Volume 0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:34.821142 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c4bfe399-8c88-4e57-90ba-604ecd0caa2f tempest-VolumesSnapshotsTestJSON-999732573 tempest-VolumesSnapshotsTestJSON-999732573-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47" status: 404 len: 109 microversion: 2.1 time: 0.032477 Dec 07 18:47:34.821668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 254/527] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:47:34 2021] GET /compute/v2.1/os-volumes/0ee9a8e7-dcd3-47fd-b2ff-469ba03f8f47 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:47:35.722760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:35.723347 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:35.730929 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:35.731387 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:35.732213 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:35.733040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:35.757258 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lazy-loading 'flavor' on Instance uuid a54d910a-30a1-4aa9-a038-6dafd95bfa5c {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:47:35.789208 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:35.790466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:35.799023 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:35.799465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:35.801385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:35.801889 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:35.964429 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:35.980983 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cccfe2a6-f013-441e-b2ee-25574e02b654 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.199722 Dec 07 18:47:35.981710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 255/528] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:35 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:36.088228 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-818708db-9e54-4547-be86-95b97a3f2a54 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 202 len: 0 microversion: 2.20 time: 0.370516 Dec 07 18:47:36.088866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 274/529] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:47:35 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:47:36.098811 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:36.099682 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:36.107022 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:36.107735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:36.108697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:36.109312 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:36.245279 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:36.254509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:36.256143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:36.257522 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-00b21c80-e727-4322-b850-da06dac3b87e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.164412 Dec 07 18:47:36.258089 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 256/530] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:36 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:36.999007 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:36.999699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:37.006174 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:37.006624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:37.007504 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:37.007818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:37.146140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:37.157839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fe44cb42-2e27-46fd-8ff0-340ae2def8cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.163212 Dec 07 18:47:37.158486 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 275/531] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:36 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:37.276260 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:37.276970 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:37.283768 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:37.284300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:37.285145 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:37.285646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:37.427727 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:37.435612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:37.437161 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:37.438655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-27876780-221d-41e6-b33f-6259f2f288ef tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.165858 Dec 07 18:47:37.439396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 257/532] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:37 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:38.174832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:38.175469 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:38.182205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:38.182655 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:38.183432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:38.183864 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:38.325538 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:38.333795 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-11ba4858-6095-4595-82c6-f675ee99ecf6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.163573 Dec 07 18:47:38.334398 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 276/533] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:38 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:38.456454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:38.457061 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:38.463382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:38.463830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:38.464602 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:38.465036 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:38.598661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:38.606857 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:38.608362 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:38.609507 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-fd3fd905-35bc-4e11-b0ab-349d823db6b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.156885 Dec 07 18:47:38.610744 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 258/534] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:38 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:39.353083 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:39.353770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:39.360728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:39.361168 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:39.361959 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:39.362393 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:39.497858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:39.506736 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8cd40519-affa-4e4d-b3f7-8d78aee10023 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.157454 Dec 07 18:47:39.507355 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 277/535] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:39 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:39.628265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:39.628785 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:39.634944 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:39.635387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:39.636143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:39.636567 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:39.770202 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:39.778606 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:39.780127 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:39.781480 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8ebd0490-7b95-4e2d-9060-3dfc8113201e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.156885 Dec 07 18:47:39.782720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 259/536] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:39 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:40.523899 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:40.524504 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:40.530782 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:40.531217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:40.532066 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:40.532493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:40.666410 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:40.675282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-232e9b5b-c21b-4a1a-88e7-57b3a68c3b1d tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.155020 Dec 07 18:47:40.676145 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 278/537] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:40 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:40.800926 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:40.801535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:40.807916 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:40.808381 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:40.809222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:40.809663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:40.940120 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:40.947691 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:40.949203 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:40.950395 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3b8c3ae5-9023-4157-9bec-1dd757249414 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.154026 Dec 07 18:47:40.950961 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 260/538] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:40 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:41.692862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:41.693396 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:41.699581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:41.700022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:41.700777 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:41.701201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:41.832143 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:41.839692 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-99314fd2-77cf-4330-bef2-3fe25dcf5e53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.150556 Dec 07 18:47:41.840246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 279/539] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:41 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:41.967643 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:41.968254 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:41.974655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:41.975117 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:41.975907 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:41.976336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:42.108504 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:42.117140 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:42.118671 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:42.119831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-40c45f9b-9be8-4a30-84a0-40b47e26f6f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.155886 Dec 07 18:47:42.120389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 261/540] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:41 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:42.856626 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:42.857220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:42.865633 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:42.866119 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:42.866928 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:42.867355 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:42.998901 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:43.006598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-efb7f569-365a-4da3-920f-1401e3ad0392 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.153590 Dec 07 18:47:43.007101 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 280/541] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:42 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:43.138497 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:43.139009 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:43.145934 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:43.146385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:43.147189 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:43.147623 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:43.285935 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:43.293479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:43.294996 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:43.296147 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7048f6dd-2e8a-432d-9a41-77d026b70320 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.161473 Dec 07 18:47:43.296689 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 262/542] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:43 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:44.023676 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:44.024282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:44.030529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:44.030976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:44.032250 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:44.032871 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:44.172798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:44.180658 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-db1ebc93-b8c7-40d8-9aeb-52bbd3679d72 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.160623 Dec 07 18:47:44.181224 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 281/543] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:44 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:44.315993 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:44.316620 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:44.322750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:44.323198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:44.323965 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:44.324412 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:44.460732 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:44.468966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:44.471222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:44.472408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f3d5d558-7575-4ec6-8953-08e4a7bda18b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.161145 Dec 07 18:47:44.472960 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 263/544] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:44 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:45.198449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:45.199083 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:45.207675 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:45.207887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:45.211109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:45.211919 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:45.349357 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:45.357027 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-64a5c465-e586-410c-895e-839147a63ec4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.162468 Dec 07 18:47:45.357597 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 282/545] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:45 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:45.490763 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:45.491365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:45.497765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:45.498255 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:45.499024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:45.499455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:45.633204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:45.640877 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:45.642496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:45.643755 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-56b38041-790f-4a06-b14e-ce3de2e65287 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.156671 Dec 07 18:47:45.644324 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 264/546] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:45 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:47:46.373199 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:46.373802 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:46.381261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:46.381705 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:46.382511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:46.382941 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:46.520921 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:46.529000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c9fc6e78-da50-4b36-8a2d-9174fe0966c2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.159362 Dec 07 18:47:46.529573 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 283/547] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:46 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:46.662492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:46.663172 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:46.669589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:46.670070 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:46.670843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:46.671270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:46.810319 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:46.819796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:46.822030 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:46.823194 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2e3a6880-c1f8-44aa-928e-6f0d97e1e359 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.165019 Dec 07 18:47:46.823964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 265/548] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:46 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:47.546086 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:47.546691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:47.553302 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:47.553752 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:47.554580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:47.555017 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:47.687555 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:47.696307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8bac9bb1-6c27-4b21-b396-e60a0a1e2533 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.154007 Dec 07 18:47:47.696866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 284/549] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:47 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:47.840359 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:47.840952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:47.847634 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:47.848128 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:47.848926 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:47.849352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:47.987199 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:47.994893 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:47.996395 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:47.997537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3b699052-6863-49a1-80dd-aaaa30939317 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.160887 Dec 07 18:47:47.998126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 266/550] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:47 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:48.714275 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:48.714881 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:48.721721 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:48.722197 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:48.722967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:48.723398 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:48.857373 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:48.865465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-855e1251-9f79-4469-b907-d10ac114b054 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.154887 Dec 07 18:47:48.866240 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 285/551] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:48 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:49.017603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:49.018261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:49.024339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:49.024778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:49.025537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:49.025986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:49.158227 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:49.165955 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:49.167470 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:49.168650 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-aa897425-26b3-4010-ad44-71b96c9cc12c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.155777 Dec 07 18:47:49.169214 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 267/552] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:49 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:49.882535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:49.883126 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:49.889301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:49.889743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:49.890539 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:49.890966 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:50.022836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:50.030758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fac6e776-b181-4d58-8e3a-8ae1c4b967d6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.151899 Dec 07 18:47:50.031329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 286/553] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:49 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:50.187055 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:50.187587 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:50.193950 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:50.194398 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:50.195156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:50.195582 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:50.331773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:50.339348 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:50.340834 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:50.341996 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5735474d-6546-4b92-b01e-9f1e69d83c8b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.158673 Dec 07 18:47:50.342556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 268/554] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:50 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:51.048369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:51.048904 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:51.056533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.057023 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.057811 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.058275 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.192085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:51.199654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fed45ed9-144b-4340-83c3-67ab0e8bc1f5 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.155054 Dec 07 18:47:51.200216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 287/555] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:51 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:51.363088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:51.363625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:51.369891 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.370364 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.371133 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.371558 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.507738 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:51.516932 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:51.518631 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:51.519814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-97a73686-9685-42bd-abaf-8abfe79c9c45 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.161165 Dec 07 18:47:51.520376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 269/556] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:51 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:51.566687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0164c242-70b1-412f-b39a-be21f990630b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:51.567666 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0164c242-70b1-412f-b39a-be21f990630b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:51.573431 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0164c242-70b1-412f-b39a-be21f990630b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.573867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0164c242-70b1-412f-b39a-be21f990630b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.574655 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0164c242-70b1-412f-b39a-be21f990630b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.575079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0164c242-70b1-412f-b39a-be21f990630b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.644642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0164c242-70b1-412f-b39a-be21f990630b tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/action" status: 202 len: 0 microversion: 2.1 time: 0.081777 Dec 07 18:47:51.645411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 288/557] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:47:51 2021] POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:51.653088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:51.653698 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:51.660279 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.660575 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.661341 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:51.661771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:51.892717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:51.900478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-866a042f-acbf-4588-93d6-094aebbd2b6c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1749 microversion: 2.1 time: 0.251018 Dec 07 18:47:51.900988 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 270/558] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:51 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1749 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:52.216825 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:52.217535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:52.224207 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:52.224644 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:52.225415 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:52.225835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:52.360915 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:52.368672 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-41556a2f-7715-404f-aa16-518984ca5e86 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.155834 Dec 07 18:47:52.369229 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 289/559] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:52 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:52.538570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:52.539176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:52.545402 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:52.545852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:52.546656 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:52.547094 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:52.679971 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:52.687542 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:52.689778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:52.690947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1a2ede8f-1616-4630-ad3a-54d25076b6d7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1746 microversion: 2.20 time: 0.156164 Dec 07 18:47:52.691493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 271/560] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:52 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:47:52.917684 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:52.918323 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:52.925149 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:52.925856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:52.926646 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:52.927074 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:53.067817 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:53.075464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-be8860af-9adf-4928-80cd-664b465acaa8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.161419 Dec 07 18:47:53.076026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 290/561] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:52 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:53.385858 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:53.386421 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:53.392364 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:53.392806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:53.393572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:53.394030 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:53.522532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:53.530569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d7a7257a-c908-4441-b684-139c221cba03 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.148447 Dec 07 18:47:53.531338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 272/562] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:53 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:53.708931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:53.709561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:53.715808 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:53.716252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:53.717016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:53.717447 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:53.851533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:53.859156 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:53.860880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:53.862058 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bceb9399-dec2-4faa-a9cf-d2f06a02f35e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1746 microversion: 2.20 time: 0.156789 Dec 07 18:47:53.862623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 291/563] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:53 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:54.092878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:54.093478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:54.100195 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:54.100641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:54.101409 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:54.101839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:54.520509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:54.529069 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f82f40c8-b41b-41c3-a419-a385f728a276 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.439778 Dec 07 18:47:54.540232 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 273/564] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:54 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:54.548844 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:54.549566 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:54.556578 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:54.557242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:54.558073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:54.558504 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:54.693752 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:54.702061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e98171af-7ca8-4619-b0e8-52b598c978cb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.157289 Dec 07 18:47:54.702632 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 292/565] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:54 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:54.881667 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:54.882308 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:54.888179 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:54.889446 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:54.890263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:54.890931 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:55.034753 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:55.042548 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:55.044029 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:55.045159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-735b721b-a4a4-44d4-927c-5af13cd67ae5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.167771 Dec 07 18:47:55.045711 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 274/566] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:54 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:55.547349 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:55.548183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:55.554788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:55.555235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:55.556007 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:55.556440 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:55.705359 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:55.714314 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5c44af57-0788-4a95-bbf8-3a9e62144135 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.169768 Dec 07 18:47:55.714314 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 293/567] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:55 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:55.720194 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:55.720985 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:55.727392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:55.728052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:55.729028 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:55.729689 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:55.878710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:55.886905 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a37618ee-f342-48be-9862-ff1d7a20ca09 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1569 microversion: 2.1 time: 0.170553 Dec 07 18:47:55.887783 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 275/568] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:55 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:56.070513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:56.071488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:56.082645 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:56.083202 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:56.084069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:56.084585 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:56.239765 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:56.247869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:56.249352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:56.251225 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0d0204d6-7351-4175-91a4-5837233ba07f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.183810 Dec 07 18:47:56.251789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 294/569] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:56 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:56.618033 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-8aaf53b4-1e14-43ec-b377-73a06f49f693 req-4b891a33-2288-41f3-a387-058407ce34aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54d910a-30a1-4aa9-a038-6dafd95bfa5c", "name": "network-vif-plugged", "status": "completed", "tag": "5d954230-64a1-4c4f-91f6-8893ea16dc4a"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:56.620126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:47:56.620126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:47:56.630873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-8aaf53b4-1e14-43ec-b377-73a06f49f693 req-4b891a33-2288-41f3-a387-058407ce34aa service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:56.630873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-8aaf53b4-1e14-43ec-b377-73a06f49f693 req-4b891a33-2288-41f3-a387-058407ce34aa service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:56.644588 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-8aaf53b4-1e14-43ec-b377-73a06f49f693 req-4b891a33-2288-41f3-a387-058407ce34aa service nova] Creating event network-vif-plugged:5d954230-64a1-4c4f-91f6-8893ea16dc4a for instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c on hv-cinder-81969 Dec 07 18:47:56.651302 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-8aaf53b4-1e14-43ec-b377-73a06f49f693 req-4b891a33-2288-41f3-a387-058407ce34aa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037489 Dec 07 18:47:56.652055 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 276/570] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:47:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:47:56.730654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:56.732142 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:56.738852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:56.739578 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:56.740529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:56.740973 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:56.905433 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:56.910261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:56.914602 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:56.923489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:56.923982 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-51750dd7-6f02-48aa-9be0-fed6d1ea55cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.196874 Dec 07 18:47:56.924545 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:56.925759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 295/571] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:56 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:56.926348 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:56.927077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.116416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:57.125135 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-75a745e3-3d8e-42ff-a6e0-6512196c050b tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1549 microversion: 2.1 time: 0.223941 Dec 07 18:47:57.135523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 277/572] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:56 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1549 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:47:57.144270 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:57.144778 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:57.151446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.151929 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.152775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.153212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.242277 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] HTTP exception thrown: Cannot 'detach_volume' instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f while it is in vm_state rescued Dec 07 18:47:57.242520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Returning 409 to user: Cannot 'detach_volume' instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f while it is in vm_state rescued {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:47:57.247879 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3ba39cd6-3866-40f5-8dc1-3b4623a2cdec tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments/83f72751-905d-485c-90c0-64e76977f5cc" status: 409 len: 152 microversion: 2.1 time: 0.103623 Dec 07 18:47:57.247879 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 296/573] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:47:57 2021] DELETE /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments/83f72751-905d-485c-90c0-64e76977f5cc => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 07 18:47:57.254303 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-752a9811-b3b1-42e1-9005-4dc67b41c112 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:47:57.257077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-752a9811-b3b1-42e1-9005-4dc67b41c112 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:57.261634 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752a9811-b3b1-42e1-9005-4dc67b41c112 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.262233 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752a9811-b3b1-42e1-9005-4dc67b41c112 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.263020 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752a9811-b3b1-42e1-9005-4dc67b41c112 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.263798 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-752a9811-b3b1-42e1-9005-4dc67b41c112 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.271726 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:57.275430 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:57.284367 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.284959 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.286332 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.286703 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.350486 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-752a9811-b3b1-42e1-9005-4dc67b41c112 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action" status: 202 len: 0 microversion: 2.1 time: 0.101016 Dec 07 18:47:57.351124 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 278/574] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:47:57 2021] POST /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:47:57.360995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:57.361714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:57.368842 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.370780 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.372960 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.375696 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.483618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:57.496621 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:57.498897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:57.503263 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4aa486db-1753-4fe7-a7d5-8b9aae302118 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.238266 Dec 07 18:47:57.504825 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 297/575] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:57 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:47:57.661646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:57.669735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0b305868-5ce8-4d2b-abce-222a80380498 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1557 microversion: 2.1 time: 0.314293 Dec 07 18:47:57.671130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 279/576] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:57 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1557 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:57.943912 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:57.944757 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:57.956701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.957150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:57.960717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:57.961301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:58.210419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:58.220147 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-890d2cb1-9dee-4bc4-8e7a-81e5a5c356bf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.279851 Dec 07 18:47:58.233013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 298/577] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:57 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:58.525765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:58.527764 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:58.535477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:58.536178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:58.537143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:58.537590 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:58.687280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:58.690404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:58.691580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:58.697067 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:58.697524 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:58.698346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:58.698768 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:58.699828 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:58.701344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:58.702913 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7f9c576b-6924-45d8-9ef4-4d2de55d9839 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.182937 Dec 07 18:47:58.704235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 280/578] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:58 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:58.868949 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:58.880568 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-104c00ff-cc22-4589-a0ec-32d05308168c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1557 microversion: 2.1 time: 0.195581 Dec 07 18:47:58.881392 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 299/579] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:58 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1557 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:59.237806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:59.238534 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:59.245257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:59.245821 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:59.246707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:59.247210 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:59.418091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:59.426631 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2e7cd05b-db26-4d68-9e45-81cbdfbb3348 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.193475 Dec 07 18:47:59.427209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 281/580] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:59 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:47:59.723420 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:59.724682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:59.731940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:59.732424 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:59.733340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:59.733773 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:59.883078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:59.891969 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:59.893806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:47:59.895052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9c13d35a-6d92-4945-94d0-b6632b06dc28 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.177611 Dec 07 18:47:59.895621 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 300/581] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:47:59 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:47:59.898570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:47:59.899188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:47:59.905605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:59.906095 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:47:59.907412 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:47:59.907949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:00.053083 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:00.061506 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3d92a71c-39f7-4b14-8591-626b5f1258c7 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1557 microversion: 2.1 time: 0.166585 Dec 07 18:48:00.072379 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 282/582] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:47:59 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:00.447546 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:00.448167 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:00.455280 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:00.455820 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:00.456614 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:00.457054 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:00.611745 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:00.620328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9089b850-d6f2-4a30-b55b-75be3d7672b4 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.176517 Dec 07 18:48:00.621103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 301/583] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:00 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:00.913560 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:00.914143 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:00.920695 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:00.921144 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:00.922086 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:00.923189 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:01.086062 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:01.088519 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:01.089240 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:01.097977 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:01.099500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:01.100698 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-87d1e8e6-33e2-4c20-8091-0ee3c11fca89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.190990 Dec 07 18:48:01.101666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 283/584] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:00 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:01.124642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:01.125637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:01.126882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:01.127384 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:01.297312 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:01.308294 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-10a89744-290d-4c59-88f7-f73a355e4111 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1557 microversion: 2.1 time: 0.232342 Dec 07 18:48:01.308880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 302/585] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:01 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:01.637996 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:01.638535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:01.645187 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:01.645642 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:01.646532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:01.646972 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:01.805321 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:01.814101 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-29fec1b7-4f2b-40dc-99cb-a5d816ff263c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.179788 Dec 07 18:48:01.814854 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 284/586] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:01 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:02.127277 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:02.127903 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:02.134016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:02.134465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:02.135245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:02.135678 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:02.285690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:02.293790 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:02.297805 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:02.300637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9aeb1490-bad5-4782-9c46-16533413e3ae tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.179435 Dec 07 18:48:02.301218 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 303/587] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:02 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:02.326393 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:02.327003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:02.333374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:02.333818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:02.334635 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:02.335074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:02.500076 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:02.510431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-80ac2838-825c-474e-9d4c-383b0525a91c tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1557 microversion: 2.1 time: 0.188149 Dec 07 18:48:02.511603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 285/588] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:02 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1557 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:02.831126 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:02.831719 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:02.841992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:02.842483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:02.843274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:02.843859 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.002893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:03.016611 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-326ce9bf-91dc-4eb7-9797-b4ef54d4663c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.189013 Dec 07 18:48:03.017249 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 304/589] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:02 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:03.319188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:03.319694 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:03.326965 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.327572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.328268 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.329107 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.526359 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:03.528282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:03.528897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:03.537665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.538142 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.538929 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.539534 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:03.539742 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.541281 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:03.542599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ad3456df-108a-44b1-be35-281fc5487a91 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.227194 Dec 07 18:48:03.543682 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 286/590] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:03 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:03.707283 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:03.715812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bda8b4bd-4011-4bcd-a1f3-e592102b5cb6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1563 microversion: 2.1 time: 0.191370 Dec 07 18:48:03.728259 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 305/591] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:03 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1563 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:03.796971 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:03.797468 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:03.803715 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.804168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.805151 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.805583 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.889572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lazy-loading 'services' on Instance uuid a5651cc9-ef23-4b3a-bfc6-dd832eaec69f {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:48:03.977886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1ff154b5-3f5d-42eb-b3b1-be608f88aaef tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments/83f72751-905d-485c-90c0-64e76977f5cc" status: 202 len: 0 microversion: 2.1 time: 0.184505 Dec 07 18:48:03.982166 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 287/592] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:48:03 2021] DELETE /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments/83f72751-905d-485c-90c0-64e76977f5cc => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:48:03.987840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cbe025f1-6676-4378-8ec8-98f48389b528 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:03.988814 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cbe025f1-6676-4378-8ec8-98f48389b528 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:03.996590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbe025f1-6676-4378-8ec8-98f48389b528 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.997028 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbe025f1-6676-4378-8ec8-98f48389b528 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:03.998114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbe025f1-6676-4378-8ec8-98f48389b528 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:03.998756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbe025f1-6676-4378-8ec8-98f48389b528 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:04.045190 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:04.045902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:04.046059 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cbe025f1-6676-4378-8ec8-98f48389b528 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062128 Dec 07 18:48:04.048127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 306/593] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:48:03 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:04.061500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:04.061500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:04.061500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:04.061500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:04.265375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:04.273537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4e11ab89-0341-401d-827a-4ce2ce3d9367 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.242136 Dec 07 18:48:04.274555 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 288/594] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:04 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:04.561475 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:04.562094 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:04.569091 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:04.569981 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:04.570944 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:04.571559 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:04.751827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:04.761253 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:04.764933 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:04.766739 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8664f2e7-ae34-4bac-b683-9dfe33e17773 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.208933 Dec 07 18:48:04.767617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 307/595] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:04 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:05.060507 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c3f16528-d213-476c-b28b-e2db6ba1ce53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:05.062333 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c3f16528-d213-476c-b28b-e2db6ba1ce53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:05.070772 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c3f16528-d213-476c-b28b-e2db6ba1ce53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:05.071914 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c3f16528-d213-476c-b28b-e2db6ba1ce53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:05.073828 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c3f16528-d213-476c-b28b-e2db6ba1ce53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:05.074718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c3f16528-d213-476c-b28b-e2db6ba1ce53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:05.107209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c3f16528-d213-476c-b28b-e2db6ba1ce53 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050804 Dec 07 18:48:05.107777 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 289/596] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:48:05 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:48:05.292885 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:05.293561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:05.300981 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:05.301517 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:05.302387 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:05.302988 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:05.467079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:05.474900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-95f1f1c4-4315-41af-bd58-5023a46cbb07 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.186264 Dec 07 18:48:05.475467 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 308/597] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:05 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:05.784614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:05.785216 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:05.791085 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:05.791538 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:05.792311 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:05.792748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:05.921374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:05.929325 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:05.930868 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:05.932025 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-47e23cc9-5516-4ea4-bc2b-0a780e7ea78c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1741 microversion: 2.20 time: 0.151423 Dec 07 18:48:05.932589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 290/598] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:05 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:06.492303 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:06.492922 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:06.499365 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:06.499805 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:06.500642 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:06.501062 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:06.646419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:06.654213 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bc41213b-4c90-4c5b-b4aa-ede034e84f24 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.165544 Dec 07 18:48:06.654784 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 309/599] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:06 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:06.950629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:06.951227 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:06.958581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:06.959029 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:06.959803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:06.960234 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:07.091875 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:07.100281 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:07.101781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:07.102958 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f4bfdd1e-43d9-4e7f-a7e1-8ccd22f81232 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1723 microversion: 2.20 time: 0.156005 Dec 07 18:48:07.103521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 291/600] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:06 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:07.671653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:07.672998 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:07.679911 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:07.680360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:07.681127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:07.681559 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:07.826788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:07.835091 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f52d17e2-cd96-48ee-9a38-d19630b910cf tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.167410 Dec 07 18:48:07.835669 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 310/601] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:07 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:08.121943 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:08.122543 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:08.128934 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:08.129370 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:08.130151 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:08.130578 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:08.258919 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:08.266477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:08.267970 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:08.269109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-35ad9245-6729-447d-88cb-5c8c88d90fd3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1723 microversion: 2.20 time: 0.150952 Dec 07 18:48:08.269664 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 292/602] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:08 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:08.852204 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:08.852848 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:08.859602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:08.860247 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:08.861022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:08.861456 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:09.003418 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:09.011077 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-46a03e07-12d6-4807-a3de-0ed2dd8ffe73 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.162573 Dec 07 18:48:09.011653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 311/603] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:08 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:09.287254 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:09.287892 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:09.294140 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:09.294593 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:09.295367 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:09.295801 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:09.432987 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:09.442086 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:09.443582 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:09.444745 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9f91462d-da15-4ca4-af21-5dbb22eee8c2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1723 microversion: 2.20 time: 0.161214 Dec 07 18:48:09.445296 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 293/604] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:09 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:09.738105 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-dcb5da69-20c8-49c4-b40a-659ccc28b0d6 req-8cc204b7-aa08-42f7-ac9c-0fe48c8cc143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54d910a-30a1-4aa9-a038-6dafd95bfa5c", "name": "network-vif-unplugged", "status": "completed", "tag": "5d954230-64a1-4c4f-91f6-8893ea16dc4a"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:09.739660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:09.739660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:09.748469 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-dcb5da69-20c8-49c4-b40a-659ccc28b0d6 req-8cc204b7-aa08-42f7-ac9c-0fe48c8cc143 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:09.749039 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-dcb5da69-20c8-49c4-b40a-659ccc28b0d6 req-8cc204b7-aa08-42f7-ac9c-0fe48c8cc143 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:09.761111 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-dcb5da69-20c8-49c4-b40a-659ccc28b0d6 req-8cc204b7-aa08-42f7-ac9c-0fe48c8cc143 service nova] Creating event network-vif-unplugged:5d954230-64a1-4c4f-91f6-8893ea16dc4a for instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c on hv-cinder-81969 Dec 07 18:48:09.766968 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-dcb5da69-20c8-49c4-b40a-659ccc28b0d6 req-8cc204b7-aa08-42f7-ac9c-0fe48c8cc143 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032039 Dec 07 18:48:09.767758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 312/605] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:10.028423 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:10.029019 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:10.035684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.036152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.037194 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.038009 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.187103 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:10.196303 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1f8567c6-358c-43d1-aa4d-78504664864e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.171462 Dec 07 18:48:10.196879 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 294/606] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:10 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:10.464489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:10.465177 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:10.471350 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.471795 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.472678 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.473098 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.587892 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:10.588457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:10.594973 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.595428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.596215 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.596650 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.613106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:10.620696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:10.622150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:10.622444 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:48:10.623283 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-08fdf779-a64e-47b0-ba00-f7292d16855d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1666 microversion: 2.20 time: 0.163294 Dec 07 18:48:10.623840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 313/607] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:10 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:10.642163 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-33eeac63-dfc8-4c84-9c9d-895c08bbe5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "576e21cd-e704-4e49-9d76-d5be6f64ef50"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:10.643238 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-33eeac63-dfc8-4c84-9c9d-895c08bbe5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:10.649002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-33eeac63-dfc8-4c84-9c9d-895c08bbe5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.649449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-33eeac63-dfc8-4c84-9c9d-895c08bbe5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.650235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-33eeac63-dfc8-4c84-9c9d-895c08bbe5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.650690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-33eeac63-dfc8-4c84-9c9d-895c08bbe5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.700580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6222643a-5035-4c13-907d-6167b42634ba tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 204 len: 0 microversion: 2.1 time: 0.116228 Dec 07 18:48:10.701173 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 295/608] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:48:10 2021] DELETE /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:48:10.710118 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:10.710815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:10.716467 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.716915 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.717692 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:10.718168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:10.858956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:10.867333 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-59779a53-3ef3-4c0b-b82c-12d2a66a6ce6 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1509 microversion: 2.1 time: 0.161088 Dec 07 18:48:10.868147 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 296/609] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:10 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:10.939092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-33eeac63-dfc8-4c84-9c9d-895c08bbe5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301428 Dec 07 18:48:10.939782 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 314/610] 10.222.0.41 () {62 vars in 1363 bytes} [Tue Dec 7 18:48:10 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:48:11.045774 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f6600cc5-aa50-4ae7-86f3-cda3df319ba0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:11.046474 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f6600cc5-aa50-4ae7-86f3-cda3df319ba0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:11.052624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f6600cc5-aa50-4ae7-86f3-cda3df319ba0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.053071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f6600cc5-aa50-4ae7-86f3-cda3df319ba0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:11.053839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f6600cc5-aa50-4ae7-86f3-cda3df319ba0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.054296 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f6600cc5-aa50-4ae7-86f3-cda3df319ba0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:11.143697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f6600cc5-aa50-4ae7-86f3-cda3df319ba0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action" status: 202 len: 0 microversion: 2.20 time: 0.101552 Dec 07 18:48:11.144582 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 297/611] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:48:11 2021] POST /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:48:11.153702 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:11.154326 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:11.161069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.161513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:11.162405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.162839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:11.212299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:11.213041 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:11.219442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.220042 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:11.220947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.221460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:11.299635 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:11.308321 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:11.310338 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:11.311798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d61aeb1c-2238-458b-b883-c3f756664c55 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1752 microversion: 2.20 time: 0.162161 Dec 07 18:48:11.312912 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 315/612] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:11 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:11.375470 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:11.383321 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b23caa83-49df-4b8d-bc62-dc2a806a9772 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.174690 Dec 07 18:48:11.383897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 298/613] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:11 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:11.884325 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:11.884927 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:11.891715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.892160 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:11.892934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:11.893365 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:12.028514 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:12.036969 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ff9e1fb1-1de7-4190-9848-0c00c6dd57cd tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1509 microversion: 2.1 time: 0.156284 Dec 07 18:48:12.037546 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 316/614] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:11 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:12.330815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:12.331397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:12.337291 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:12.337746 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:12.338551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:12.338992 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:12.400403 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:12.401015 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:12.407060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:12.407498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:12.408259 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:12.408683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:12.471290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:12.479776 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:12.481405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:12.482878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-fb146fbc-8fc4-4f1b-96da-2eb3c7843500 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1754 microversion: 2.20 time: 0.155826 Dec 07 18:48:12.483661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 299/615] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:12 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:12.565301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:12.573135 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dac33f52-b41d-4e3e-97c2-3c049aa41d1e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.176467 Dec 07 18:48:12.573785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 317/616] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:12 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:13.054209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:13.054840 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:13.060966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:13.061416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:13.062214 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:13.063243 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:13.385129 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:13.393645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b524291b-956d-4916-9a42-b414d922e912 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1509 microversion: 2.1 time: 0.343400 Dec 07 18:48:13.394372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 300/617] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:13 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1509 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:13.503356 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:13.503962 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:13.510700 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:13.511154 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:13.511935 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:13.512371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:13.594554 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:13.595167 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:13.602320 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:13.606498 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:13.607395 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:13.607849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:13.665304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:13.674011 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:13.675840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:13.676980 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f24e139b-11bb-447b-beb4-e19b2e508f67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.178294 Dec 07 18:48:13.677551 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 318/618] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:13 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:13.951991 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:13.961084 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ebcbb0af-4a45-4c20-a48c-89d8ea71d375 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1754 microversion: 2.1 time: 0.372793 Dec 07 18:48:13.962000 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 301/619] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:13 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1754 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:14.124170 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-cbd6329c-c279-4586-a41c-048835f4757b req-6e1be1b1-0240-445d-bd9e-434f9cc8ab75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9b1241-e140-4789-9341-cb20006c6eba", "name": "network-vif-deleted", "tag": "f19111d7-a12d-47fe-8e06-28405cf67baa"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:14.126833 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:14.126833 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:14.134193 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-cbd6329c-c279-4586-a41c-048835f4757b req-6e1be1b1-0240-445d-bd9e-434f9cc8ab75 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:14.134768 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-cbd6329c-c279-4586-a41c-048835f4757b req-6e1be1b1-0240-445d-bd9e-434f9cc8ab75 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:14.151314 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-cbd6329c-c279-4586-a41c-048835f4757b req-6e1be1b1-0240-445d-bd9e-434f9cc8ab75 service nova] Creating event network-vif-deleted:f19111d7-a12d-47fe-8e06-28405cf67baa for instance fb9b1241-e140-4789-9341-cb20006c6eba on hv-cinder-81969 Dec 07 18:48:14.156982 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-cbd6329c-c279-4586-a41c-048835f4757b req-6e1be1b1-0240-445d-bd9e-434f9cc8ab75 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035914 Dec 07 18:48:14.157771 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 319/620] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:14.411171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:14.411760 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:14.418077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:14.418524 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:14.419338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:14.419772 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:14.454387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:14.454834 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:14.455295 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lazy-loading 'fault' on Instance uuid fb9b1241-e140-4789-9341-cb20006c6eba {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:48:14.495325 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:14.502937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0cc6a073-70d5-4470-b17a-e5aa21b5c0f4 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 200 len: 1312 microversion: 2.1 time: 0.095504 Dec 07 18:48:14.512477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 302/621] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:14 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:14.697988 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:14.699493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:14.707938 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:14.708392 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:14.709175 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:14.709609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:14.908085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:14.917210 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:14.919045 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:14.920736 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d79af3fa-ddf8-4b45-8c4a-efdbc80dc33b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.228251 Dec 07 18:48:14.933139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 320/622] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:14 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:14.979660 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:14.980551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:14.999255 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:14.999734 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.000919 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.001366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.183133 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:15.192366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cf62d5b1-534f-41b3-a5d9-e36488bb699c tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1757 microversion: 2.1 time: 0.216226 Dec 07 18:48:15.193624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 303/623] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:14 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:15.519890 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:15.520790 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: fb9b1241-e140-4789-9341-cb20006c6eba] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:15.526893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.527557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.528506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.529097 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.544059 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] HTTP exception thrown: Instance fb9b1241-e140-4789-9341-cb20006c6eba could not be found. Dec 07 18:48:15.544658 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Returning 404 to user: Instance fb9b1241-e140-4789-9341-cb20006c6eba could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:48:15.545486 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-08cafd65-4c88-42ad-bccc-1591b8efac18 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba" status: 404 len: 111 microversion: 2.1 time: 0.029295 Dec 07 18:48:15.546412 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 321/624] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:15 2021] GET /compute/v2.1/servers/fb9b1241-e140-4789-9341-cb20006c6eba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:48:15.560301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:15.561575 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:15.571851 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.572520 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.574800 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.575461 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.610356 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:48:15.711424 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4e920141-a92f-4a76-bd50-7375a129fffa tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 204 len: 0 microversion: 2.1 time: 0.158204 Dec 07 18:48:15.722639 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:15.723329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:15.728804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 304/625] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:48:15 2021] DELETE /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:48:15.731449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.732268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.733424 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.734624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.899068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:15.911119 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e22a4467-17be-450b-b4a8-987da04a48f9 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.193948 Dec 07 18:48:15.914046 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 322/626] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:15 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:15.940861 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:15.941728 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:15.947378 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.947825 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:15.948657 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:15.949156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:16.104983 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:16.120528 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:16.122703 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:16.124280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3b81a49d-c646-40ae-afa8-3c4ee1acf3d6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.187811 Dec 07 18:48:16.125237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 305/627] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:15 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:16.928801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:16.930089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:16.936985 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:16.938369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:16.939429 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:16.940004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:17.094770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:17.102025 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bf8010a5-e5ec-4543-ba65-4d15facf89ab tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.177144 Dec 07 18:48:17.102572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 323/628] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:16 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:17.143637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:17.145325 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:17.153966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:17.154684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:17.156614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:17.157301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:17.303900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:17.304649 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:17.311466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:17.318661 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:17.319358 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:17.321572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:17.322886 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:17.331725 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:17.333284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:17.334513 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-96609101-bc3c-44d1-a4ab-8ebecbb6feaf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.195145 Dec 07 18:48:17.335085 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 306/629] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:17 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:17.408533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lazy-loading 'services' on Instance uuid 668cc429-6322-4b0b-8f3a-6d910c891444 {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:48:17.478815 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ee2dd554-7b26-43f9-b124-21f18248ace4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-volume_attachments/1286bd2a-498c-495d-b740-6cabaed81364" status: 202 len: 0 microversion: 2.1 time: 0.178772 Dec 07 18:48:17.483413 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 324/630] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:48:17 2021] DELETE /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-volume_attachments/1286bd2a-498c-495d-b740-6cabaed81364 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:48:18.119679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:18.120324 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:18.126862 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:18.127314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:18.128091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:18.128522 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:18.268851 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:18.276126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e6d1c950-1ded-4843-a9ee-ab0def93d4ad tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.160264 Dec 07 18:48:18.276693 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 307/631] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:18 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:18.356819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:18.357494 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:18.364767 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:18.365517 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:18.366413 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:18.366990 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:18.506876 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:18.517443 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:18.518963 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:18.520276 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f05048df-e08e-4396-ae5a-79a8cc9694a2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.169797 Dec 07 18:48:18.525969 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 325/632] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:18 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:19.295374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:19.297088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:19.310742 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:19.314490 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:19.315503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:19.316093 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:19.500636 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:19.510455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4e478920-794b-4fa2-8112-3d79785d0fc1 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.220164 Dec 07 18:48:19.513022 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 308/633] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:19 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:19.538796 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:19.540056 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:19.547460 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:19.548270 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:19.549287 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:19.550315 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:19.738263 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:19.746839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:19.748319 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:19.749464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cbbb7e6a-e8b6-4e12-9de4-4b21dd79164a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.215222 Dec 07 18:48:19.750172 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 326/634] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:19 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:20.528070 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:20.529531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:20.544252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:20.545152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:20.546243 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:20.546995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:20.715266 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:20.724219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-571b0025-f10b-4e5a-bfb5-fdb112245156 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.199722 Dec 07 18:48:20.724795 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 309/635] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:20 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:20.769691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:20.771528 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:20.779762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:20.780515 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:20.782114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:20.782694 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:20.940438 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:20.950593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:20.953381 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:20.955240 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0df2d9cf-23a8-4e06-9d7e-eb313b23ecce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.191146 Dec 07 18:48:20.956545 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 327/636] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:20 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:21.741102 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:21.745176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:21.753087 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:21.753750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:21.754458 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:21.754949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:21.970694 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:21.975177 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:21.976494 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:21.982161 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2b7816b3-cb52-4b71-9b52-f37cbc4b2b52 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.244544 Dec 07 18:48:21.982783 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 310/637] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:21 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:21.990065 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:21.992550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:21.993171 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:21.993663 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:22.166401 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:22.177184 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:22.184462 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:22.192248 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a772f6bc-f1f7-46a8-8147-71572047e255 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.221665 Dec 07 18:48:22.195989 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 328/638] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:21 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:48:22.999959 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:23.000563 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:23.007670 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:23.008532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:23.009561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:23.010254 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:23.148605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:23.157674 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cd4362f0-4eca-4703-b867-190d948b90fb tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.161705 Dec 07 18:48:23.158531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 311/639] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:22 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:23.214022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:23.214628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:23.221450 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:23.221890 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:23.222680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:23.223106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:23.360247 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:23.368360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:23.369844 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:23.371031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0cb932fd-e035-47a7-923b-1e7b60678778 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.160741 Dec 07 18:48:23.371586 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 329/640] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:23 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:48:23.580253 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-144779489", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:23.630992 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] validate_networks() for None {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:48:24.136706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:48:24.137332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:48:24.137570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:48:24.138041 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:48:24.138446 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:48:24.148432 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:24.149252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:24.150686 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:24.151523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:24.172155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Getting quotas for project 540bf05e797b4011b36fc2583675e4b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:48:24.175336 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:24.175942 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:24.176792 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Getting quotas for user 2b24e379c4d54888a69b7c8e09ec1d85 and project 540bf05e797b4011b36fc2583675e4b6. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:48:24.185781 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:24.186305 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:24.187658 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:24.188094 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:24.188387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:48:24.190773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:48:24.243802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6e55c6ce-6886-4411-a35b-fa85ec99fd02 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667251 Dec 07 18:48:24.251112 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 312/641] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:48:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:48:24.261221 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-84eb247a-5f58-4368-a92d-7ba1945ad41f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:24.262132 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-84eb247a-5f58-4368-a92d-7ba1945ad41f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:24.328604 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-84eb247a-5f58-4368-a92d-7ba1945ad41f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:24.335727 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-84eb247a-5f58-4368-a92d-7ba1945ad41f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1214 microversion: 2.1 time: 0.082856 Dec 07 18:48:24.336386 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 313/642] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:24 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:24.339180 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:24.347950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-18a4aa8e-f704-4783-aaae-464f01dd3dbf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.176443 Dec 07 18:48:24.348534 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 330/643] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:24 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:24.396310 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:24.396906 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:24.403714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:24.404130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:24.405028 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:24.405496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:24.565704 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:24.583316 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:24.585949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:24.587961 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-eb4c8e24-5993-481d-b831-e79ef2ca221c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.195017 Dec 07 18:48:24.598060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 314/644] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:24 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:25.353044 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:25.353619 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:25.360861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:25.361328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:25.362640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:25.363306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:25.365433 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:25.366126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:25.372383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:25.372896 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:25.373849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:25.374442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:25.437465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:25.445593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-72503686-547b-42c4-b49e-f0dd526fa1af tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1218 microversion: 2.1 time: 0.096135 Dec 07 18:48:25.446614 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 331/645] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:25 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:25.525180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:25.532937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b328e240-d945-4aa8-aabe-19914f0525d2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.171546 Dec 07 18:48:25.533512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 315/646] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:25 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:25.608182 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:25.608728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:25.615495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:25.615940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:25.616707 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:25.617133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:25.761863 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:25.770961 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:25.772463 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:25.773617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f05ce36a-42f9-4aff-ab23-05db200b8e68 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.169321 Dec 07 18:48:25.774209 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 332/647] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:25 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:26.467263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:26.467962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:26.475901 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:26.476358 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:26.477154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:26.477680 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:26.543505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:26.549456 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:26.550362 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:26.551310 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e2408623-061d-4342-b786-6451c3155352 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1218 microversion: 2.1 time: 0.087803 Dec 07 18:48:26.551884 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 316/648] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:26 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:26.561956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:26.561956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:26.561956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:26.561956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:26.692956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:26.700421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3fa164f1-5d07-4e5d-a324-bb6431b65a39 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.154581 Dec 07 18:48:26.700996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 333/649] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:26 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:26.793056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:26.793885 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:26.802065 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:26.802514 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:26.803289 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:26.803716 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:26.938261 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:26.946387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:26.947884 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:26.949062 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-70c2d1ab-76c1-4997-9641-e8be3d972813 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.161044 Dec 07 18:48:26.949628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 317/650] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:26 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:27.568353 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:27.568951 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:27.575158 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:27.575600 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:27.576357 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:27.576779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:27.635940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:27.643107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f446a072-8b98-46fe-8c11-bccaea4e4095 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1266 microversion: 2.1 time: 0.078761 Dec 07 18:48:27.643668 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 334/651] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:27 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:27.717771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:27.718959 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:27.725153 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:27.725641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:27.726585 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:27.727026 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:27.856601 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:27.864524 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2cafe0f7-21a9-43e9-9797-74862ab507ea tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.150403 Dec 07 18:48:27.865078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 318/652] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:27 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:27.969745 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:27.970513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:27.976624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:27.977148 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:27.977950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:27.978407 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:28.126576 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:28.135683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:28.137183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:28.138759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7331fdf8-3407-40a5-ad77-67b27c4b2ad1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.173851 Dec 07 18:48:28.139242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 335/653] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:27 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:28.661456 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:28.662104 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:28.668004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:28.668455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:28.669255 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:28.669685 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:28.736052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:28.743186 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-428d9116-fd3b-4d59-af89-4604825c180a tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1272 microversion: 2.1 time: 0.086746 Dec 07 18:48:28.743759 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 319/654] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:28 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:28.882002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:28.882764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:28.889882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:28.890486 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:28.891161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:28.891594 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.035805 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:29.043125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0c7cc564-1847-4243-85df-f31616d00bdf tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.165208 Dec 07 18:48:29.043697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 336/655] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:28 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:29.156828 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:29.157667 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:29.164024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.164640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.165577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.166193 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.177159 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-304e99b0-b40b-486e-85ce-678b9a627be1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:29.183176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-304e99b0-b40b-486e-85ce-678b9a627be1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.183840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-304e99b0-b40b-486e-85ce-678b9a627be1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.209036 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-304e99b0-b40b-486e-85ce-678b9a627be1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Going to try to stop instance {{(pid=122585) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 07 18:48:29.253318 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-304e99b0-b40b-486e-85ce-678b9a627be1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 202 len: 0 microversion: 2.1 time: 0.079785 Dec 07 18:48:29.254495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 337/656] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:48:29 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:48:29.263319 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:29.264011 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:29.275459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.275904 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.277305 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.277953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.436746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:29.444550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8af0906f-9386-4ff5-aef6-51b27cf7c773 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.185853 Dec 07 18:48:29.445147 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 338/657] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:29 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:29.462467 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:29.472112 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:29.473626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:29.474848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-47346376-8dfb-438b-b168-4d64c430b085 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.321990 Dec 07 18:48:29.491718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 320/658] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:29 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:29.645561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-20af0a27-55d9-4d0c-8ab5-a6067b9d67c9 req-6d6a3479-5795-4c28-913e-fca876620882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e20c420-b07a-4b05-a7e0-3edf0bb14d20", "tag": "ddee1f44-86f3-46df-a40a-55150ba07f1b"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:29.647342 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:29.647342 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:29.655987 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-20af0a27-55d9-4d0c-8ab5-a6067b9d67c9 req-6d6a3479-5795-4c28-913e-fca876620882 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.656717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-20af0a27-55d9-4d0c-8ab5-a6067b9d67c9 req-6d6a3479-5795-4c28-913e-fca876620882 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.670946 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-20af0a27-55d9-4d0c-8ab5-a6067b9d67c9 req-6d6a3479-5795-4c28-913e-fca876620882 service nova] Creating event network-changed:ddee1f44-86f3-46df-a40a-55150ba07f1b for instance 4e20c420-b07a-4b05-a7e0-3edf0bb14d20 on hv-cinder-81969 Dec 07 18:48:29.677645 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-20af0a27-55d9-4d0c-8ab5-a6067b9d67c9 req-6d6a3479-5795-4c28-913e-fca876620882 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044038 Dec 07 18:48:29.678849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 339/659] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:29.760531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:29.761555 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:29.768743 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.769354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.770348 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:29.770878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:29.952952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:29.960302 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3b47ced5-7708-4c02-be37-7232765a1987 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1314 microversion: 2.1 time: 0.203623 Dec 07 18:48:29.960878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 321/660] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:29 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:30.059742 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:30.060464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:30.067480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.067920 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:30.068690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.069116 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:30.210757 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:30.218139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-11d8c1e5-9167-4c6f-bbb4-67b787d70659 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.162251 Dec 07 18:48:30.219176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 340/661] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:30 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:30.463041 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:30.463666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:30.469671 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.470164 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:30.470963 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.471390 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:30.494344 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:30.495080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:30.501579 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.502164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:30.503004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.503520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:30.646827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:30.655080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:30.656816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:30.657994 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-103059b6-c942-462f-9f8d-e9fe2de92a1d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.167714 Dec 07 18:48:30.658565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 341/662] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:30 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:48:30.715603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:30.722935 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b24f8cc0-59fe-4320-af47-7e6c844d651f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.263533 Dec 07 18:48:30.723510 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 322/663] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:30 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:30.976365 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:30.976962 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:30.982772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.983214 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:30.983971 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:30.985190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:31.118616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:31.126143 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a723ff8d-de41-40e7-9f15-e6424039815d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1314 microversion: 2.1 time: 0.153150 Dec 07 18:48:31.127043 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 342/664] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:30 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:31.235886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:31.236393 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:31.242789 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:31.243240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:31.243994 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:31.244421 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:31.373645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:31.381510 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-45fab628-7553-483d-bf4e-245a94152ae2 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.150013 Dec 07 18:48:31.382109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 323/665] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:31 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:31.676983 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:31.677507 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:31.683392 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:31.683834 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:31.684602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:31.685032 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:31.740278 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:31.740881 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:31.746892 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:31.747992 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:31.748905 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:31.749534 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:31.818825 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:31.826902 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:31.829196 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:31.830311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d0cb46df-55c8-4d6a-bec3-b8e7f7b73f56 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.157415 Dec 07 18:48:31.831083 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 343/666] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:31 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:31.879416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:31.886632 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e6522b84-a62b-4776-818c-20170e639ecd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.150039 Dec 07 18:48:31.887196 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 324/667] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:31 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:32.142250 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:32.142852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:32.149320 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.149764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.150652 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.151281 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.285206 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:32.292429 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7332c046-5cf5-47a0-8af1-8538549482dd tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1314 microversion: 2.1 time: 0.153876 Dec 07 18:48:32.292989 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 344/668] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:32 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:32.399198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:32.399714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:32.406729 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.407183 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.407963 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.408399 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.541472 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:32.548847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1bc6a57d-1a3b-4d86-91c7-2e3894afb8d0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.153362 Dec 07 18:48:32.549424 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 325/669] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:32 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:32.848854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:32.849450 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:32.855277 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.855720 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.856475 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.856901 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.904329 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:32.904936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:32.911310 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.911761 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.912536 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:32.912969 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:32.992385 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:33.002135 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:33.003624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:33.004771 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-954df34d-d72f-463f-a8f6-05f2a303cff2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.159628 Dec 07 18:48:33.005337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 345/670] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:32 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:33.047791 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:33.055314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0187ae1a-2793-43ca-a402-91f5cda4e0fd tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.154678 Dec 07 18:48:33.055888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 326/671] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:32 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:33.309807 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:33.310421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:33.317242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:33.317677 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:33.318464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:33.318891 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:33.447519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:33.454641 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d27ccda7-6165-4b9b-aea8-cb1ddc603d4d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1314 microversion: 2.1 time: 0.148613 Dec 07 18:48:33.455218 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 346/672] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:33 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:33.566059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:33.566626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:33.573159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:33.573637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:33.574436 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:33.574872 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:33.794651 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90a40a0ea3f4365b5813347c6027244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0284a24444edf87293c9fe818e638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:33.802450 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-83bc17c3-0dce-4088-bc5a-e556fa5470b0 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 200 len: 1523 microversion: 2.1 time: 0.240283 Dec 07 18:48:33.803031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 327/673] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:33 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:34.022989 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:34.024234 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:34.031578 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.032038 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.032970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.033421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.072688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:34.073575 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:34.080712 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.081159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.081976 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.082463 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.188628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:34.197473 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:34.199006 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:34.200162 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5ad49b04-3250-4b12-af9a-90fa2f46e198 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.181185 Dec 07 18:48:34.212271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 347/674] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:34 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:48:34.212271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-5812f1a0-b176-4283-b929-4f63559f911a req-619aea27-35c4-477c-b8c8-9cee0a7d51c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5651cc9-ef23-4b3a-bfc6-dd832eaec69f", "name": "network-vif-deleted", "tag": "0668d3b9-3bd1-4d53-b1dc-5a28aa27efa9"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:34.212271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:34.212271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:34.214879 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-5812f1a0-b176-4283-b929-4f63559f911a req-619aea27-35c4-477c-b8c8-9cee0a7d51c9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.215315 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-5812f1a0-b176-4283-b929-4f63559f911a req-619aea27-35c4-477c-b8c8-9cee0a7d51c9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.229482 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-5812f1a0-b176-4283-b929-4f63559f911a req-619aea27-35c4-477c-b8c8-9cee0a7d51c9 service nova] Creating event network-vif-deleted:0668d3b9-3bd1-4d53-b1dc-5a28aa27efa9 for instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f on hv-cinder-81969 Dec 07 18:48:34.234374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:34.235535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-5812f1a0-b176-4283-b929-4f63559f911a req-619aea27-35c4-477c-b8c8-9cee0a7d51c9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 Dec 07 18:48:34.236123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 348/675] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:34.242371 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3b1a643a-8f8e-402a-add1-f17355c29f11 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.173654 Dec 07 18:48:34.242941 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 328/676] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:34 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:34.472498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:34.473178 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:34.479212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.479651 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.480406 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.480828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.639559 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:34.649747 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e549f90b-4e9c-4f5c-a392-6c2d3f6d811f tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1314 microversion: 2.1 time: 0.181291 Dec 07 18:48:34.660282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 349/677] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:34 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:34.819254 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:34.819851 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] [instance: a5651cc9-ef23-4b3a-bfc6-dd832eaec69f] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:34.826080 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.826526 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.827292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.827720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.841402 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] HTTP exception thrown: Instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f could not be found. Dec 07 18:48:34.842077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] Returning 404 to user: Instance a5651cc9-ef23-4b3a-bfc6-dd832eaec69f could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:48:34.842890 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-67e65d38-af6d-467f-bdad-976ad52ac971 tempest-ServerRescueNegativeTestJSON-1614351223 tempest-ServerRescueNegativeTestJSON-1614351223-project] 10.222.0.41 "GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f" status: 404 len: 111 microversion: 2.1 time: 0.027356 Dec 07 18:48:34.843577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 329/678] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:34 2021] GET /compute/v2.1/servers/a5651cc9-ef23-4b3a-bfc6-dd832eaec69f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:48:34.925362 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-a5483c64-d878-44ce-8ec1-bf42334b5646 req-f8527868-698e-4330-b76e-d4340c3cb534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e20c420-b07a-4b05-a7e0-3edf0bb14d20", "name": "network-vif-plugged", "status": "completed", "tag": "ddee1f44-86f3-46df-a40a-55150ba07f1b"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:34.927035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:34.927035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:34.935088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-a5483c64-d878-44ce-8ec1-bf42334b5646 req-f8527868-698e-4330-b76e-d4340c3cb534 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:34.935849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-a5483c64-d878-44ce-8ec1-bf42334b5646 req-f8527868-698e-4330-b76e-d4340c3cb534 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:34.948365 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-a5483c64-d878-44ce-8ec1-bf42334b5646 req-f8527868-698e-4330-b76e-d4340c3cb534 service nova] Creating event network-vif-plugged:ddee1f44-86f3-46df-a40a-55150ba07f1b for instance 4e20c420-b07a-4b05-a7e0-3edf0bb14d20 on hv-cinder-81969 Dec 07 18:48:34.953796 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-a5483c64-d878-44ce-8ec1-bf42334b5646 req-f8527868-698e-4330-b76e-d4340c3cb534 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 Dec 07 18:48:34.954443 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 350/679] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:48:35.219970 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:35.220617 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:35.226428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:35.226883 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:35.227663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:35.228337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:35.264132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:35.264877 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:35.278318 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:35.279370 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:35.280540 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:35.281652 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:35.391528 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:35.400962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:35.402509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:35.403665 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0958b256-b0f9-4c13-af8f-d48708940fce tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.188210 Dec 07 18:48:35.404294 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 330/680] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:35 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:35.578630 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:35.585822 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0b70907e-51b2-4c08-8b0a-c3a799db675d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.327994 Dec 07 18:48:35.586432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 351/681] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:35 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:35.666777 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:35.667498 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:35.674079 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:35.674534 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:35.675562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:35.675993 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:35.811701 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:35.820089 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1bb40426-65ae-474c-8b04-f363294ab2e4 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1314 microversion: 2.1 time: 0.156878 Dec 07 18:48:35.820717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 331/682] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:35 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:36.425440 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:36.426572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:36.433459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:36.434192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:36.435217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:36.435764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:36.603001 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:36.611607 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:36.618658 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:36.619355 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:36.620313 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:36.620913 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:36.749322 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:36.768773 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:36.770565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:36.771921 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-66397558-8646-4fff-a293-5251343c8c17 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.353144 Dec 07 18:48:36.773111 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 352/683] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:36 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:36.789237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:36.799052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-619af083-2414-4dd0-8839-0af57d373067 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.199683 Dec 07 18:48:36.800113 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 332/684] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:36 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:36.847792 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:36.849144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:36.859789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:36.860595 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:36.861664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:36.865829 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:36.978908 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-ab70d65c-9e39-414c-b0f2-e2f2014bc39a req-4e0b8c37-d460-400f-9d2b-53dc677b228a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54d910a-30a1-4aa9-a038-6dafd95bfa5c", "name": "network-vif-plugged", "status": "completed", "tag": "5d954230-64a1-4c4f-91f6-8893ea16dc4a"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:36.980561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:36.980561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:48:36.992525 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-ab70d65c-9e39-414c-b0f2-e2f2014bc39a req-4e0b8c37-d460-400f-9d2b-53dc677b228a service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:36.993212 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-ab70d65c-9e39-414c-b0f2-e2f2014bc39a req-4e0b8c37-d460-400f-9d2b-53dc677b228a service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.006699 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-ab70d65c-9e39-414c-b0f2-e2f2014bc39a req-4e0b8c37-d460-400f-9d2b-53dc677b228a service nova] Creating event network-vif-plugged:5d954230-64a1-4c4f-91f6-8893ea16dc4a for instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c on hv-cinder-81969 Dec 07 18:48:37.015798 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-ab70d65c-9e39-414c-b0f2-e2f2014bc39a req-4e0b8c37-d460-400f-9d2b-53dc677b228a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040233 Dec 07 18:48:37.022283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 333/685] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:37.063316 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:37.075638 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dd1e89dc-7a77-497d-b226-9c17d803bf22 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1463 microversion: 2.1 time: 0.232709 Dec 07 18:48:37.082062 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 353/686] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:36 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1463 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:37.124321 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:37.126647 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:37.133686 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.134166 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.134945 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.135374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.163620 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:48:37.252843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-173c65ff-8d4e-4ab4-b155-97e2588fe294 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 204 len: 0 microversion: 2.1 time: 0.132591 Dec 07 18:48:37.253529 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 334/687] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:48:37 2021] DELETE /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:48:37.263340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:37.263956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:37.271630 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.272233 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.273040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.273480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.462061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:37.470327 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-70c8ac73-7435-44b1-82a4-15e1c8763c5d tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1469 microversion: 2.1 time: 0.212179 Dec 07 18:48:37.482746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 354/688] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:37 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:37.791542 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:37.792235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:37.799392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.800087 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.800863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.801287 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.817002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:37.817609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:37.824101 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.824762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.825556 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:37.826021 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:37.965801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:37.974188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-77246a9b-0648-4c28-99d6-e6eb3f327ee8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.160748 Dec 07 18:48:37.974682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 355/689] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:37 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:38.267397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:38.275580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:38.277073 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:38.278415 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b73ad31e-621c-4511-8604-60e177a39d4c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.491055 Dec 07 18:48:38.278977 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 335/690] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:37 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:38.490219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:38.490917 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:38.498336 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:38.499066 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:38.499959 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:38.500706 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:38.745801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:38.753953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d52b1ec0-eb54-431d-bd03-6deded6632c1 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1469 microversion: 2.1 time: 0.267758 Dec 07 18:48:38.754531 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 356/691] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:38 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:38.990966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:38.991566 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:39.005157 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:39.006055 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:39.006657 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:39.007093 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:39.229996 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:39.239824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-de1e8846-5658-4abd-a972-533541951db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.252324 Dec 07 18:48:39.240889 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 336/692] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:38 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:39.300608 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:39.301216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:39.310568 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:39.311013 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:39.312975 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:39.313843 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:39.522235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:39.541337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:39.543167 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:39.544951 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-007e2076-3b14-49a8-9f53-0f3733032249 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1810 microversion: 2.20 time: 0.249492 Dec 07 18:48:39.546628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 357/693] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:39 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1810 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:39.704334 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-d9324a96-804c-4b82-baf6-bdf10bf331cc req-b1f811d0-7f4b-4a8d-be65-ce9b091b8586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e20c420-b07a-4b05-a7e0-3edf0bb14d20", "name": "network-vif-deleted", "tag": "ddee1f44-86f3-46df-a40a-55150ba07f1b"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:39.706815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:39.706815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:48:39.714410 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d9324a96-804c-4b82-baf6-bdf10bf331cc req-b1f811d0-7f4b-4a8d-be65-ce9b091b8586 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:39.715105 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d9324a96-804c-4b82-baf6-bdf10bf331cc req-b1f811d0-7f4b-4a8d-be65-ce9b091b8586 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:39.739429 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-d9324a96-804c-4b82-baf6-bdf10bf331cc req-b1f811d0-7f4b-4a8d-be65-ce9b091b8586 service nova] Creating event network-vif-deleted:ddee1f44-86f3-46df-a40a-55150ba07f1b for instance 4e20c420-b07a-4b05-a7e0-3edf0bb14d20 on hv-cinder-81969 Dec 07 18:48:39.753467 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-d9324a96-804c-4b82-baf6-bdf10bf331cc req-b1f811d0-7f4b-4a8d-be65-ce9b091b8586 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054069 Dec 07 18:48:39.754914 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 337/694] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:39.771378 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:39.771976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:39.779629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:39.780076 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:39.781441 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:39.785520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:39.876776 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b24e379c4d54888a69b7c8e09ec1d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '540bf05e797b4011b36fc2583675e4b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:39.884208 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5ec2cd2d-0aaf-4fef-a07e-c169aebf0f53 tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 200 len: 1299 microversion: 2.1 time: 0.116397 Dec 07 18:48:39.884939 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 358/695] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:39 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:40.230396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ab23afcd-8454-4e04-be0a-a549aca3bd07 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Action: 'create', calling method: .version_select at 0x7f19981e54c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1112789456", "metadata": {"Type": "work"}}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:40.257215 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:40.257824 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:40.267342 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:40.267798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:40.268628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:40.269055 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:40.420961 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:40.429185 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b9c09dec-baef-4902-90e5-6a17c9762c96 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.175967 Dec 07 18:48:40.429761 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 359/696] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:40 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:40.438970 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ab23afcd-8454-4e04-be0a-a549aca3bd07 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.328580 Dec 07 18:48:40.439589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 338/697] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Dec 7 18:48:40 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 330 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Dec 07 18:48:40.450027 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8116033b-62dc-4251-b554-c4cb2add8d14 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Calling method '.version_select at 0x7f198bf97ee0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:40.500595 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8116033b-62dc-4251-b554-c4cb2add8d14 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2" status: 200 len: 353 microversion: 2.1 time: 0.054121 Dec 07 18:48:40.501413 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 360/698] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:48:40 2021] GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:40.564888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:40.565606 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:40.572133 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:40.572582 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:40.573349 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:40.573780 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:40.705586 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:40.713769 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:40.715308 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:40.716461 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-396601ce-6977-473f-b880-c1f11a36d23b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1797 microversion: 2.20 time: 0.156365 Dec 07 18:48:40.717032 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 339/699] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:48:40 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1797 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:48:40.902478 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:40.902997 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] [instance: 4e20c420-b07a-4b05-a7e0-3edf0bb14d20] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:40.909535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:40.910007 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:40.910766 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:40.911192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:40.925089 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] HTTP exception thrown: Instance 4e20c420-b07a-4b05-a7e0-3edf0bb14d20 could not be found. Dec 07 18:48:40.925655 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] Returning 404 to user: Instance 4e20c420-b07a-4b05-a7e0-3edf0bb14d20 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:48:40.926479 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-46f4e3aa-167b-4003-8bf7-7c9e02351e1c tempest-VolumesNegativeTest-1743177251 tempest-VolumesNegativeTest-1743177251-project] 10.222.0.41 "GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20" status: 404 len: 111 microversion: 2.1 time: 0.028003 Dec 07 18:48:40.927004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 361/700] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:40 2021] GET /compute/v2.1/servers/4e20c420-b07a-4b05-a7e0-3edf0bb14d20 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:48:41.446697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:41.447276 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:41.454361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:41.454814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:41.455633 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:41.456069 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:41.512150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-140d6d7e-7c22-4db2-ba3c-cd267eadaec0 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Calling method '.version_select at 0x7f199803db80>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:41.563729 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-140d6d7e-7c22-4db2-ba3c-cd267eadaec0 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2" status: 200 len: 354 microversion: 2.1 time: 0.055018 Dec 07 18:48:41.564301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 362/701] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:48:41 2021] GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:48:41.575202 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e31d47d0-4e91-4c67-a795-08d5f75bdd3d tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Calling method '.version_select at 0x7f19980cc550>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:41.600866 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:41.609700 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4a2506e5-04e4-4dd2-853b-a014f9e5ceea tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.166600 Dec 07 18:48:41.610851 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 340/702] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:41 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:41.622609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e31d47d0-4e91-4c67-a795-08d5f75bdd3d tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2" status: 200 len: 354 microversion: 2.1 time: 0.051502 Dec 07 18:48:41.623184 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 363/703] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:48:41 2021] GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:48:41.639944 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-91b1dca6-7f2d-40a2-851f-0212e1ce7c12 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Calling method '.version_select at 0x7f19981e51f0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:41.705036 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-91b1dca6-7f2d-40a2-851f-0212e1ce7c12 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2" status: 202 len: 0 microversion: 2.1 time: 0.068636 Dec 07 18:48:41.706115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 341/704] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Dec 7 18:48:41 2021] DELETE /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:48:41.714115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-08e81169-7611-4301-911c-2dd2ed52abf9 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Calling method '.version_select at 0x7f198bfdfdc0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:41.769124 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-08e81169-7611-4301-911c-2dd2ed52abf9 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2" status: 200 len: 353 microversion: 2.1 time: 0.058758 Dec 07 18:48:41.769685 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 364/705] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:48:41 2021] GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:42.627673 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:42.627888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:42.633865 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:42.634625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:42.635819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:42.635819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:42.776794 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:42.785641 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1c4bbde8-939e-48cb-ac5e-103b99523f56 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Calling method '.version_select at 0x7f19980cc550>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:42.789041 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-dfea1ee1-116c-4b29-bc5c-027ff249c21e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.165859 Dec 07 18:48:42.789611 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 342/706] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:42 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:42.820310 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-1c4bbde8-939e-48cb-ac5e-103b99523f56 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] HTTP exception thrown: Volume f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 could not be found. Dec 07 18:48:42.820915 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1c4bbde8-939e-48cb-ac5e-103b99523f56 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] Returning 404 to user: Volume f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:48:42.821752 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1c4bbde8-939e-48cb-ac5e-103b99523f56 tempest-VolumesGetTestJSON-603345198 tempest-VolumesGetTestJSON-603345198-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2" status: 404 len: 109 microversion: 2.1 time: 0.044131 Dec 07 18:48:42.822374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 365/707] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:48:42 2021] GET /compute/v2.1/os-volumes/f5a69cb9-4c63-42b3-bd9a-1de44560f0f2 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:48:43.807224 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:43.807962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:43.815721 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:43.816172 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:43.816948 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:43.817376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:43.952791 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:43.960133 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d12b2144-1b6d-4472-a83c-2b5e0171be65 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1679 microversion: 2.1 time: 0.156495 Dec 07 18:48:43.960773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 343/708] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:43 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:44.979846 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:44.980307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:44.986545 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:44.987149 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:44.988078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:44.988618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:45.156176 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:45.163508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d7967f2b-0170-40a1-90f9-d5ebdc639d28 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1656 microversion: 2.1 time: 0.188977 Dec 07 18:48:45.164078 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 366/709] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:44 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1656 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:45.181299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7b47887b-406b-4c5d-9281-a2c218cbf84b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:45.189382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7b47887b-406b-4c5d-9281-a2c218cbf84b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:45.189830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7b47887b-406b-4c5d-9281-a2c218cbf84b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:45.211510 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7b47887b-406b-4c5d-9281-a2c218cbf84b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Going to try to start instance {{(pid=122586) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 07 18:48:45.254819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7b47887b-406b-4c5d-9281-a2c218cbf84b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action" status: 202 len: 0 microversion: 2.1 time: 0.076868 Dec 07 18:48:45.256218 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 344/710] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:48:45 2021] POST /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:48:45.264528 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:45.265408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:45.272618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:45.273273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:45.274199 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:45.274794 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:45.448686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:45.457789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-de26e813-d73e-4231-bdbd-e8bc19794860 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1665 microversion: 2.1 time: 0.197409 Dec 07 18:48:45.459195 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 367/711] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:45 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1665 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:46.477094 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:46.478106 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:46.485207 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:46.485951 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:46.486907 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:46.487416 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:46.628735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:46.638040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3c6bd6bf-68a4-4f2e-b8ea-e851d958168c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1669 microversion: 2.1 time: 0.164687 Dec 07 18:48:46.639000 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 345/712] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:46 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:48.236870 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1077996577", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "63fc2b78-f69b-4eb4-88bc-0e61b27ee4f8"}]}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:48.288576 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] validate_networks() for [('63fc2b78-f69b-4eb4-88bc-0e61b27ee4f8', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:48:48.635863 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:48:48.636273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:48:48.636736 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:48:48.637135 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:48:48.637543 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:48:48.646894 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:48.647340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:48.648139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:48.648570 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:48.665189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Getting quotas for project 103d606fa1a54ad8993058e83b59a30c. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:48:48.669462 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Getting quotas for user 3533bdc77e13492cb30ede2634402c48 and project 103d606fa1a54ad8993058e83b59a30c. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:48:48.684268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:48:48.688882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:48:48.733404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [80611418-b387-4a55-b4e0-14cc1ba3d066] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 07 18:48:49.749679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [80611418-b387-4a55-b4e0-14cc1ba3d066] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 59542. Dec 07 18:48:49.754527 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e36140f6-5468-4bc8-b832-844790b20daf tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522055 Dec 07 18:48:49.755180 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 368/713] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:48:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 07 18:48:49.764654 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ed652bae-dfc7-43a4-b56a-9d9e64dc5093 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:49.765253 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ed652bae-dfc7-43a4-b56a-9d9e64dc5093 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:49.820026 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ed652bae-dfc7-43a4-b56a-9d9e64dc5093 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:49.826651 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ed652bae-dfc7-43a4-b56a-9d9e64dc5093 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1219 microversion: 2.1 time: 0.065633 Dec 07 18:48:49.827373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 346/714] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:49 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:50.846297 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:50.846912 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:50.853506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:50.853980 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:50.854760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:50.855189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:50.917677 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:50.925709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9fe885cc-9515-43a2-a4e8-cb27cc5d3a79 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1277 microversion: 2.1 time: 0.085499 Dec 07 18:48:50.926394 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 369/715] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:50 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:51.943517 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:51.944158 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:51.951805 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:51.952268 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:51.953615 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:51.954095 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:52.004794 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-fb4b8329-048e-41b2-9359-a99718ed1b2c req-2cfee675-14b7-47ba-b9b3-2db306711835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd55682-7fc8-4b23-b5f8-0bb90865a2cd", "tag": "804851cf-f4a4-40c0-a158-517510794afb"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:52.006400 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:52.006400 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:52.013791 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-fb4b8329-048e-41b2-9359-a99718ed1b2c req-2cfee675-14b7-47ba-b9b3-2db306711835 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:52.014261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-fb4b8329-048e-41b2-9359-a99718ed1b2c req-2cfee675-14b7-47ba-b9b3-2db306711835 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:52.026397 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-fb4b8329-048e-41b2-9359-a99718ed1b2c req-2cfee675-14b7-47ba-b9b3-2db306711835 service nova] Creating event network-changed:804851cf-f4a4-40c0-a158-517510794afb for instance 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd on hv-cinder-81969 Dec 07 18:48:52.031258 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-fb4b8329-048e-41b2-9359-a99718ed1b2c req-2cfee675-14b7-47ba-b9b3-2db306711835 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030228 Dec 07 18:48:52.032654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 370/716] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:48:52.214672 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:52.222171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ec522b75-70b0-489f-b5cb-7a7ad7fc9bc5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1319 microversion: 2.1 time: 0.282480 Dec 07 18:48:52.222955 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 347/717] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:51 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:52.322052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2109883156"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:52.322693 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:52.329564 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:52.330126 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:52.330941 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:52.331370 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:52.470861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.network.security_group_api [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Removing security group 07b8a811-66f4-4a24-808c-06e6dc4476b7 from port 6c4ac575-82d3-4c88-90cb-0083321e1635 Dec 07 18:48:52.893191 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-28389665-b9d5-4b71-bd68-9d2355c5066e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/action" status: 202 len: 0 microversion: 2.1 time: 0.575228 Dec 07 18:48:52.896996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 371/718] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:48:52 2021] POST /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:48:52.901374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-3dd11a11-dc86-47f0-b81a-70cf1df2a3d5 req-2cf85a70-c46e-46b5-b80a-ad895df9ffd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669946de-d56d-400a-aa4e-0b1c8ab97e46", "tag": "6c4ac575-82d3-4c88-90cb-0083321e1635"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:52.903137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:52.903137 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:48:52.919945 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-3dd11a11-dc86-47f0-b81a-70cf1df2a3d5 req-2cf85a70-c46e-46b5-b80a-ad895df9ffd6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:52.924310 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-3dd11a11-dc86-47f0-b81a-70cf1df2a3d5 req-2cf85a70-c46e-46b5-b80a-ad895df9ffd6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:52.957666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-3dd11a11-dc86-47f0-b81a-70cf1df2a3d5 req-2cf85a70-c46e-46b5-b80a-ad895df9ffd6 service nova] Creating event network-changed:6c4ac575-82d3-4c88-90cb-0083321e1635 for instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 on hv-cinder-81969 Dec 07 18:48:52.970867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-3dd11a11-dc86-47f0-b81a-70cf1df2a3d5 req-2cf85a70-c46e-46b5-b80a-ad895df9ffd6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072753 Dec 07 18:48:52.972035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 348/719] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:53.239747 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:53.241483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:53.249023 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:53.249798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:53.251516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:53.252313 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:53.482506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:53.490704 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-050e911d-1d7d-49e9-8730-475791a401d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1319 microversion: 2.1 time: 0.255243 Dec 07 18:48:53.491511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 372/720] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:53 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:54.171178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:54.171818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:54.179060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:54.179588 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:54.180375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:54.180817 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:54.260293 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lazy-loading 'services' on Instance uuid 669946de-d56d-400a-aa4e-0b1c8ab97e46 {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:48:54.337373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5457a30e-6f27-49b9-a834-530d1fad6037 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "DELETE /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments/892a3528-56df-4681-a160-da10a2b284c7" status: 202 len: 0 microversion: 2.1 time: 0.170679 Dec 07 18:48:54.338119 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 349/721] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:48:54 2021] DELETE /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments/892a3528-56df-4681-a160-da10a2b284c7 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:48:54.347504 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fc49565a-455a-4168-8447-653b52468680 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:54.349751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fc49565a-455a-4168-8447-653b52468680 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:54.358903 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc49565a-455a-4168-8447-653b52468680 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:54.360245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc49565a-455a-4168-8447-653b52468680 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:54.361054 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc49565a-455a-4168-8447-653b52468680 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:54.361680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc49565a-455a-4168-8447-653b52468680 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:54.396969 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fc49565a-455a-4168-8447-653b52468680 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053772 Dec 07 18:48:54.401181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 373/722] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:48:54 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:54.509097 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:54.509738 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:54.515753 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:54.516197 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:54.517158 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:54.517588 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:54.646920 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:54.654198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-08fe82d4-495c-4fc4-a362-f55bb7dd673d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1319 microversion: 2.1 time: 0.149256 Dec 07 18:48:54.654770 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 350/723] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:54 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:54.991114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-c76c76ff-6de4-4ac1-9b91-0a6587d6627d req-691816e8-30bb-4cb4-8377-876f213efb78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "669946de-d56d-400a-aa4e-0b1c8ab97e46", "tag": "6c4ac575-82d3-4c88-90cb-0083321e1635"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:54.992740 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:54.992740 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:54.999687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-c76c76ff-6de4-4ac1-9b91-0a6587d6627d req-691816e8-30bb-4cb4-8377-876f213efb78 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:55.000187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-c76c76ff-6de4-4ac1-9b91-0a6587d6627d req-691816e8-30bb-4cb4-8377-876f213efb78 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:55.010809 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-c76c76ff-6de4-4ac1-9b91-0a6587d6627d req-691816e8-30bb-4cb4-8377-876f213efb78 service nova] Creating event network-changed:6c4ac575-82d3-4c88-90cb-0083321e1635 for instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 on hv-cinder-81969 Dec 07 18:48:55.016349 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-c76c76ff-6de4-4ac1-9b91-0a6587d6627d req-691816e8-30bb-4cb4-8377-876f213efb78 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028307 Dec 07 18:48:55.017021 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 374/724] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:55.409360 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-868dd86e-88b7-4179-a022-14ee6cf7af67 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:55.411493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-868dd86e-88b7-4179-a022-14ee6cf7af67 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:55.423922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-868dd86e-88b7-4179-a022-14ee6cf7af67 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:55.424390 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-868dd86e-88b7-4179-a022-14ee6cf7af67 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:55.425465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-868dd86e-88b7-4179-a022-14ee6cf7af67 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:55.425931 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-868dd86e-88b7-4179-a022-14ee6cf7af67 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:55.466036 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-868dd86e-88b7-4179-a022-14ee6cf7af67 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061322 Dec 07 18:48:55.466786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 351/725] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:48:55 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:48:55.478020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:55.478609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:55.488764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:55.489351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:55.490267 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:55.490819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:55.569521 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] HTTP exception thrown: Instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 is not attached to volume 892a3528-56df-4681-a160-da10a2b284c7 Dec 07 18:48:55.570535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Returning 404 to user: Instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 is not attached to volume 892a3528-56df-4681-a160-da10a2b284c7 {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:48:55.571624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-25b911ea-e861-4999-add7-47cd23587699 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "DELETE /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments/892a3528-56df-4681-a160-da10a2b284c7" status: 404 len: 154 microversion: 2.1 time: 0.098359 Dec 07 18:48:55.572562 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 375/726] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:48:55 2021] DELETE /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46/os-volume_attachments/892a3528-56df-4681-a160-da10a2b284c7 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:48:55.671082 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:55.672440 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:55.680032 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:55.680478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:55.681282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:55.681708 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:55.811325 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:55.819391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f7535fe1-6d24-4d76-b75d-e5c7d4a6cecb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1319 microversion: 2.1 time: 0.151944 Dec 07 18:48:55.820020 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 352/727] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:55 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:56.711382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:56.711882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:56.718550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:56.719229 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:56.720058 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:56.720490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:56.744598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:48:56.822421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4cec9c64-a0db-47a9-962e-852c73c11d0e tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "DELETE /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 204 len: 0 microversion: 2.1 time: 0.114309 Dec 07 18:48:56.823018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 376/728] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:48:56 2021] DELETE /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:48:56.832710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:56.833564 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:56.838604 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:56.839357 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:56.841085 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:56.842187 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:56.842986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:56.844405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:56.845729 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:56.846357 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:56.847130 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:56.847553 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:56.988872 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:56.995215 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:56.996007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-63b3414a-e900-44df-ab53-5368c39c9db8 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1551 microversion: 2.1 time: 0.167961 Dec 07 18:48:56.996580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 353/729] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:56 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:57.001214 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-5867faf1-7164-4849-8bf0-56359e7c378a req-04c3c4d9-2f50-4102-a772-6bc3a63f08d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd55682-7fc8-4b23-b5f8-0bb90865a2cd", "name": "network-vif-plugged", "status": "completed", "tag": "804851cf-f4a4-40c0-a158-517510794afb"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:57.002787 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ce99b594-c9b3-487d-9aee-f1e30919a62c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1319 microversion: 2.1 time: 0.168504 Dec 07 18:48:57.002925 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:57.002925 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:48:57.003341 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 377/730] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:56 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:57.009630 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-5867faf1-7164-4849-8bf0-56359e7c378a req-04c3c4d9-2f50-4102-a772-6bc3a63f08d6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:57.010101 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-5867faf1-7164-4849-8bf0-56359e7c378a req-04c3c4d9-2f50-4102-a772-6bc3a63f08d6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:57.021107 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-5867faf1-7164-4849-8bf0-56359e7c378a req-04c3c4d9-2f50-4102-a772-6bc3a63f08d6 service nova] Creating event network-vif-plugged:804851cf-f4a4-40c0-a158-517510794afb for instance 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd on hv-cinder-81969 Dec 07 18:48:57.025786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-5867faf1-7164-4849-8bf0-56359e7c378a req-04c3c4d9-2f50-4102-a772-6bc3a63f08d6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028135 Dec 07 18:48:57.026400 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 354/731] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:48:58.012141 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:58.012742 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:58.019824 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:58.020279 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:58.020673 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:58.021224 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:58.021368 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:58.021469 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:58.027238 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:58.027679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:58.028439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:58.028865 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:58.157794 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:58.165025 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:58.166146 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a2305159-2393-4f5a-9713-259168b2a40a tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1551 microversion: 2.1 time: 0.157547 Dec 07 18:48:58.166731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 378/732] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:58 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:58.177445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6d12a4e1-d595-4fbb-ae6b-be4fc58c07be tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1319 microversion: 2.1 time: 0.161098 Dec 07 18:48:58.178238 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 355/733] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:58 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:48:59.183337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:59.184127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:59.193021 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:59.193540 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:59.194503 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:59.195019 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:59.197018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:48:59.197841 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:48:59.207659 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:59.208677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:59.210665 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:59.211736 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:59.349618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1520b91805ad483193835c75157a16f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c42061bf6e4acb909fab4c8dbc4c0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:59.358132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1602808a-0dbb-4acc-a1bc-2ddf25d53e26 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 200 len: 1551 microversion: 2.1 time: 0.178221 Dec 07 18:48:59.358705 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 379/734] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:59 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:59.447819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:48:59.459456 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6c1a4b60-6da3-444e-9570-4a510684b5f0 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1506 microversion: 2.1 time: 0.266213 Dec 07 18:48:59.460325 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 356/735] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:48:59 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1506 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:48:59.735499 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-f70fc355-4d4a-41ab-a72a-ae1faf1f546f req-fa4086e2-b76f-4d0b-bb94-45aaaa68082a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "669946de-d56d-400a-aa4e-0b1c8ab97e46", "name": "network-vif-deleted", "tag": "6c4ac575-82d3-4c88-90cb-0083321e1635"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:48:59.737505 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:48:59.737505 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:48:59.745430 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-f70fc355-4d4a-41ab-a72a-ae1faf1f546f req-fa4086e2-b76f-4d0b-bb94-45aaaa68082a service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:48:59.745875 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-f70fc355-4d4a-41ab-a72a-ae1faf1f546f req-fa4086e2-b76f-4d0b-bb94-45aaaa68082a service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:48:59.760965 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-f70fc355-4d4a-41ab-a72a-ae1faf1f546f req-fa4086e2-b76f-4d0b-bb94-45aaaa68082a service nova] Creating event network-vif-deleted:6c4ac575-82d3-4c88-90cb-0083321e1635 for instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 on hv-cinder-81969 Dec 07 18:48:59.768866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-f70fc355-4d4a-41ab-a72a-ae1faf1f546f req-fa4086e2-b76f-4d0b-bb94-45aaaa68082a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037333 Dec 07 18:48:59.770419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 380/736] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:48:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:49:00.377688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:00.379392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [instance: 669946de-d56d-400a-aa4e-0b1c8ab97e46] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:00.388003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:00.388857 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:00.390226 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:00.391565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:00.409251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] HTTP exception thrown: Instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 could not be found. Dec 07 18:49:00.409881 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Returning 404 to user: Instance 669946de-d56d-400a-aa4e-0b1c8ab97e46 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:49:00.411229 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-efc9f10c-ddc4-4f06-a4e4-ea6b5a11487d tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46" status: 404 len: 111 microversion: 2.1 time: 0.039231 Dec 07 18:49:00.411788 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 357/737] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:00 2021] GET /compute/v2.1/servers/669946de-d56d-400a-aa4e-0b1c8ab97e46 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:49:00.421344 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6b0dbc00-d017-4908-8f45-c95dab837780 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] Calling method '.version_select at 0x7f1998012c10>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:00.425578 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6b0dbc00-d017-4908-8f45-c95dab837780 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [61c74f84-858c-4720-acfd-5796098af0c5] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 07 18:49:01.446067 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [None req-6b0dbc00-d017-4908-8f45-c95dab837780 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] [61c74f84-858c-4720-acfd-5796098af0c5] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 59838. Dec 07 18:49:01.483923 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6b0dbc00-d017-4908-8f45-c95dab837780 tempest-TestMinimumBasicScenario-1028198325 tempest-TestMinimumBasicScenario-1028198325-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-772467978" status: 202 len: 0 microversion: 2.1 time: 1.066700 Dec 07 18:49:01.484867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 381/738] 10.222.0.41 () {58 vars in 1268 bytes} [Tue Dec 7 18:49:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-772467978 => generated 0 bytes in 1069 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:49:18.873152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b95b427c-f6fc-4752-9f6e-376af6c8abd1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a3cdf5f-b2db-45e1-a8cd-b18f344471cb", "device": "/dev/sdb"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:18.875354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b95b427c-f6fc-4752-9f6e-376af6c8abd1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:18.881359 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b95b427c-f6fc-4752-9f6e-376af6c8abd1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:18.881803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b95b427c-f6fc-4752-9f6e-376af6c8abd1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:18.882624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b95b427c-f6fc-4752-9f6e-376af6c8abd1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:18.883059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b95b427c-f6fc-4752-9f6e-376af6c8abd1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:19.127467 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b95b427c-f6fc-4752-9f6e-376af6c8abd1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "POST /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258389 Dec 07 18:49:19.128166 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 358/739] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:49:18 2021] POST /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:49:19.708950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b473961c-f402-48e3-bcbd-d4beeb81f9a5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:19.709563 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b473961c-f402-48e3-bcbd-d4beeb81f9a5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:19.716177 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b473961c-f402-48e3-bcbd-d4beeb81f9a5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:19.716650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b473961c-f402-48e3-bcbd-d4beeb81f9a5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:19.717423 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b473961c-f402-48e3-bcbd-d4beeb81f9a5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:19.717943 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b473961c-f402-48e3-bcbd-d4beeb81f9a5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:19.746412 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b473961c-f402-48e3-bcbd-d4beeb81f9a5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments/576e21cd-e704-4e49-9d76-d5be6f64ef50" status: 200 len: 194 microversion: 2.20 time: 0.041867 Dec 07 18:49:19.746988 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 382/740] 10.222.0.41 () {60 vars in 1453 bytes} [Tue Dec 7 18:49:19 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments/576e21cd-e704-4e49-9d76-d5be6f64ef50 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:19.807546 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:19.808129 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:19.814621 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:19.815067 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:19.815833 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:19.816263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:19.892964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lazy-loading 'services' on Instance uuid a54d910a-30a1-4aa9-a038-6dafd95bfa5c {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:49:19.961741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e2cf8b3e-5266-4599-972f-5d6a00006fcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments/576e21cd-e704-4e49-9d76-d5be6f64ef50" status: 202 len: 0 microversion: 2.20 time: 0.158169 Dec 07 18:49:19.962313 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 359/741] 10.222.0.41 () {60 vars in 1456 bytes} [Tue Dec 7 18:49:19 2021] DELETE /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments/576e21cd-e704-4e49-9d76-d5be6f64ef50 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:49:19.971010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cee56a1c-979b-4cff-a486-0bd77d36dc22 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:19.971913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cee56a1c-979b-4cff-a486-0bd77d36dc22 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:19.978374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cee56a1c-979b-4cff-a486-0bd77d36dc22 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:19.978880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cee56a1c-979b-4cff-a486-0bd77d36dc22 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:19.979607 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cee56a1c-979b-4cff-a486-0bd77d36dc22 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:19.980038 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cee56a1c-979b-4cff-a486-0bd77d36dc22 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:20.013193 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cee56a1c-979b-4cff-a486-0bd77d36dc22 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046052 Dec 07 18:49:20.013960 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 383/742] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:19 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:21.027446 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-38a90633-7685-4c16-872e-6d3f67872fe9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:21.028479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-38a90633-7685-4c16-872e-6d3f67872fe9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:21.035165 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-38a90633-7685-4c16-872e-6d3f67872fe9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:21.035608 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-38a90633-7685-4c16-872e-6d3f67872fe9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:21.036373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-38a90633-7685-4c16-872e-6d3f67872fe9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:21.036833 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-38a90633-7685-4c16-872e-6d3f67872fe9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:21.066234 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-38a90633-7685-4c16-872e-6d3f67872fe9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043339 Dec 07 18:49:21.066793 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 360/743] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:21 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:22.078166 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4397cd8a-adef-48d8-ac9f-4971fc35d308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:22.079069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4397cd8a-adef-48d8-ac9f-4971fc35d308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:22.085194 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4397cd8a-adef-48d8-ac9f-4971fc35d308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:22.085646 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4397cd8a-adef-48d8-ac9f-4971fc35d308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:22.086445 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4397cd8a-adef-48d8-ac9f-4971fc35d308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:22.086880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4397cd8a-adef-48d8-ac9f-4971fc35d308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:22.115489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4397cd8a-adef-48d8-ac9f-4971fc35d308 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041749 Dec 07 18:49:22.116072 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 384/744] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:22 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:23.127419 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-290d8c22-3363-46cf-bf3e-bd319d5826ff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:23.128265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-290d8c22-3363-46cf-bf3e-bd319d5826ff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:23.134515 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-290d8c22-3363-46cf-bf3e-bd319d5826ff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:23.134966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-290d8c22-3363-46cf-bf3e-bd319d5826ff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:23.135741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-290d8c22-3363-46cf-bf3e-bd319d5826ff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:23.136176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-290d8c22-3363-46cf-bf3e-bd319d5826ff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:23.167825 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-290d8c22-3363-46cf-bf3e-bd319d5826ff tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044292 Dec 07 18:49:23.168383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 361/745] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:23 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:24.180473 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4cc08b6b-de1b-4131-bd0f-ea2567af9501 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:24.181719 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4cc08b6b-de1b-4131-bd0f-ea2567af9501 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:24.189710 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cc08b6b-de1b-4131-bd0f-ea2567af9501 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:24.190190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cc08b6b-de1b-4131-bd0f-ea2567af9501 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:24.190963 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cc08b6b-de1b-4131-bd0f-ea2567af9501 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:24.191405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4cc08b6b-de1b-4131-bd0f-ea2567af9501 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:24.220370 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4cc08b6b-de1b-4131-bd0f-ea2567af9501 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043969 Dec 07 18:49:24.220912 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 385/746] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:24 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:25.231832 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ffb971d2-949c-49ee-9f43-503e93e8d2cf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:25.232718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ffb971d2-949c-49ee-9f43-503e93e8d2cf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:25.239204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffb971d2-949c-49ee-9f43-503e93e8d2cf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:25.239644 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffb971d2-949c-49ee-9f43-503e93e8d2cf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:25.240396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffb971d2-949c-49ee-9f43-503e93e8d2cf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:25.240819 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffb971d2-949c-49ee-9f43-503e93e8d2cf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:25.270860 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ffb971d2-949c-49ee-9f43-503e93e8d2cf tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042824 Dec 07 18:49:25.271431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 362/747] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:25 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:25.588051 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:25.588580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:25.595100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:25.595549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:25.596324 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:25.596754 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:25.618780 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lazy-loading 'flavor' on Instance uuid 6353ff89-98cf-4e56-b677-b0f9431d7e1d {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:49:25.686548 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-497ce0d4-dfa5-406c-93b9-aeeabaca5faf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "POST /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d/action" status: 202 len: 0 microversion: 2.1 time: 0.102017 Dec 07 18:49:25.687718 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 386/748] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:49:25 2021] POST /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:49:25.695888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:25.696496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:25.702330 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:25.702886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:25.703664 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:25.704097 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:25.838736 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:25.846765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-22f7ae17-1b1b-4be5-9de0-6670cbfadee4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.154500 Dec 07 18:49:25.847337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 363/749] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:25 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:26.283853 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4ae3d59d-a82a-43cf-9f22-265929218e9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:26.284843 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4ae3d59d-a82a-43cf-9f22-265929218e9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:26.290952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ae3d59d-a82a-43cf-9f22-265929218e9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:26.291400 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ae3d59d-a82a-43cf-9f22-265929218e9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:26.292161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ae3d59d-a82a-43cf-9f22-265929218e9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:26.292591 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ae3d59d-a82a-43cf-9f22-265929218e9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:26.322594 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4ae3d59d-a82a-43cf-9f22-265929218e9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Dec 07 18:49:26.323143 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 387/750] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:26 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:26.864466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:26.865071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:26.871399 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:26.871850 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:26.872622 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:26.873054 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:27.004225 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:27.011460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0843bc34-d215-4775-b031-521e16c49f43 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.150639 Dec 07 18:49:27.012024 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 364/751] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:26 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:27.334682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d17012da-1885-4ced-8e5e-192e5a8810b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:27.335585 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d17012da-1885-4ced-8e5e-192e5a8810b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:27.341788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d17012da-1885-4ced-8e5e-192e5a8810b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:27.342262 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d17012da-1885-4ced-8e5e-192e5a8810b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:27.343138 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d17012da-1885-4ced-8e5e-192e5a8810b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:27.343824 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d17012da-1885-4ced-8e5e-192e5a8810b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:27.371636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d17012da-1885-4ced-8e5e-192e5a8810b5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040748 Dec 07 18:49:27.372182 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 388/752] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:27 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:28.032573 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:28.033199 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:28.040086 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:28.040529 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:28.041296 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:28.041720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:28.182455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:28.190504 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a9d74b77-6f35-4205-b9a9-4425b6580597 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.164635 Dec 07 18:49:28.191071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 365/753] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:28 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:28.382856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b2548f55-5b04-4fa8-b12e-166f4e126f61 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:28.383682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b2548f55-5b04-4fa8-b12e-166f4e126f61 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:28.390092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2548f55-5b04-4fa8-b12e-166f4e126f61 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:28.390657 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2548f55-5b04-4fa8-b12e-166f4e126f61 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:28.391475 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2548f55-5b04-4fa8-b12e-166f4e126f61 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:28.391913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b2548f55-5b04-4fa8-b12e-166f4e126f61 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:28.421918 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b2548f55-5b04-4fa8-b12e-166f4e126f61 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042229 Dec 07 18:49:28.422828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 389/754] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:28 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:29.207636 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:29.208239 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:29.214471 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:29.214918 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:29.215672 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:29.216095 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:29.348153 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:29.355639 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-504472e1-3e65-4879-a5f1-7aad6e4ecb04 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.151788 Dec 07 18:49:29.356217 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 366/755] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:29 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:29.433863 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c6db91db-2ea4-4133-a1a4-e5296b056395 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:29.434782 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c6db91db-2ea4-4133-a1a4-e5296b056395 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:29.441544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6db91db-2ea4-4133-a1a4-e5296b056395 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:29.442028 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6db91db-2ea4-4133-a1a4-e5296b056395 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:29.442793 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6db91db-2ea4-4133-a1a4-e5296b056395 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:29.443217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6db91db-2ea4-4133-a1a4-e5296b056395 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:29.473010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c6db91db-2ea4-4133-a1a4-e5296b056395 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042799 Dec 07 18:49:29.473498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 390/756] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:29 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:30.376628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:30.377265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:30.383442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:30.383889 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:30.384653 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:30.385082 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:30.484941 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b48fa94d-415a-4193-815e-59b22aa775a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:30.485849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b48fa94d-415a-4193-815e-59b22aa775a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:30.492140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b48fa94d-415a-4193-815e-59b22aa775a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:30.492579 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b48fa94d-415a-4193-815e-59b22aa775a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:30.493359 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b48fa94d-415a-4193-815e-59b22aa775a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:30.493760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b48fa94d-415a-4193-815e-59b22aa775a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:30.522263 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b48fa94d-415a-4193-815e-59b22aa775a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041635 Dec 07 18:49:30.522829 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 391/757] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:30 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:49:30.524986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:30.533097 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b76c1f74-8331-44b3-8e81-73138951ec09 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.161088 Dec 07 18:49:30.533659 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 367/758] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:30 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:31.188893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4d238541-c81b-4ecb-a521-7fe97eebd245 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:31.189794 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4d238541-c81b-4ecb-a521-7fe97eebd245 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:31.195516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d238541-c81b-4ecb-a521-7fe97eebd245 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.195961 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d238541-c81b-4ecb-a521-7fe97eebd245 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.196772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d238541-c81b-4ecb-a521-7fe97eebd245 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.197200 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4d238541-c81b-4ecb-a521-7fe97eebd245 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.226382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4d238541-c81b-4ecb-a521-7fe97eebd245 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041809 Dec 07 18:49:31.226940 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 392/759] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:49:31 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:49:31.282050 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:31.282546 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:31.288349 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.288794 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.289560 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.290092 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.313810 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:49:31.388181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-887ff721-ce2d-4251-806a-3b21f2274989 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 204 len: 0 microversion: 2.1 time: 0.109534 Dec 07 18:49:31.389046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 368/760] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:49:31 2021] DELETE /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:49:31.398628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:31.399188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:31.404900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.405362 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.406394 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.406825 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.534683 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a7bfae27-17d3-4907-a104-317463db6954 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:31.535790 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a7bfae27-17d3-4907-a104-317463db6954 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:31.541865 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7bfae27-17d3-4907-a104-317463db6954 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.542355 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7bfae27-17d3-4907-a104-317463db6954 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.543162 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7bfae27-17d3-4907-a104-317463db6954 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.543592 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7bfae27-17d3-4907-a104-317463db6954 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.576442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a7bfae27-17d3-4907-a104-317463db6954 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046258 Dec 07 18:49:31.577001 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 369/761] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:31 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:49:31.584298 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:31.584892 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:31.590373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.590832 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.591580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:31.592007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:31.700190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:31.708230 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-71ae47a8-7124-4ca4-90e6-28e23fb4c310 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1675 microversion: 2.1 time: 0.313592 Dec 07 18:49:31.708799 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 393/762] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:31 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1675 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:31.780324 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:31.787983 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-67b9c664-8e31-46c1-ba0b-f4414c162c13 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.209351 Dec 07 18:49:31.788550 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 370/763] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:31 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:32.588542 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cfb1b5c6-2c6f-44ad-ad8a-9e41d9dd739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:32.589429 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cfb1b5c6-2c6f-44ad-ad8a-9e41d9dd739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:32.595796 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfb1b5c6-2c6f-44ad-ad8a-9e41d9dd739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:32.596238 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfb1b5c6-2c6f-44ad-ad8a-9e41d9dd739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:32.596991 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfb1b5c6-2c6f-44ad-ad8a-9e41d9dd739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:32.597414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfb1b5c6-2c6f-44ad-ad8a-9e41d9dd739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:32.626077 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cfb1b5c6-2c6f-44ad-ad8a-9e41d9dd739e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041262 Dec 07 18:49:32.626622 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 394/764] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:32 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:32.725161 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:32.725790 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:32.731982 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:32.732431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:32.733206 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:32.733748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:32.805005 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:32.805584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:32.812062 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:32.812589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:32.813445 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:32.813885 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:32.864035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:32.872712 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5fab198e-7b72-4723-bc44-cd1acefea9a8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1675 microversion: 2.1 time: 0.150212 Dec 07 18:49:32.873075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 371/765] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:32 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:32.953022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:32.960279 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-df2c040a-de66-4a82-82e9-bb16e6a68ee2 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.158931 Dec 07 18:49:32.960850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 395/766] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:32 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:33.637578 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-83791ef0-1133-4290-8617-80c08d2b18b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:33.638511 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-83791ef0-1133-4290-8617-80c08d2b18b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:33.644664 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83791ef0-1133-4290-8617-80c08d2b18b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:33.645114 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83791ef0-1133-4290-8617-80c08d2b18b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:33.645888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83791ef0-1133-4290-8617-80c08d2b18b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:33.646337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-83791ef0-1133-4290-8617-80c08d2b18b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:33.676069 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-83791ef0-1133-4290-8617-80c08d2b18b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042325 Dec 07 18:49:33.676623 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 372/767] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:33 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:49:33.889201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:33.890133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:33.896746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:33.897200 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:33.897997 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:33.898434 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:33.976530 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:33.977154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:33.984584 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:33.985035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:33.985796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:33.986246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:34.033080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:34.040429 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-acf5fc56-3fc9-45e8-8dce-bdb3781292d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1675 microversion: 2.1 time: 0.154912 Dec 07 18:49:34.041031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 396/768] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:33 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:34.119117 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:34.127393 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d9b66e8b-b3e6-4a1a-91bb-f0b127ce7318 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.154560 Dec 07 18:49:34.127967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 373/769] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:33 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:34.687858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-04d01604-3b21-40d3-8c11-4f44791b17c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:34.688774 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-04d01604-3b21-40d3-8c11-4f44791b17c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:34.694674 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-04d01604-3b21-40d3-8c11-4f44791b17c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:34.695123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-04d01604-3b21-40d3-8c11-4f44791b17c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:34.695888 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-04d01604-3b21-40d3-8c11-4f44791b17c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:34.696318 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-04d01604-3b21-40d3-8c11-4f44791b17c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:34.726810 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-04d01604-3b21-40d3-8c11-4f44791b17c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042680 Dec 07 18:49:34.727533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 397/770] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:49:34 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:34.784172 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:34.784653 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:34.790824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:34.791012 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:34.792117 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:34.794754 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:34.819285 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:49:34.908301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ebbc57db-d080-4359-9e57-646aae49d60c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 204 len: 0 microversion: 2.20 time: 0.128143 Dec 07 18:49:34.908888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 374/771] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Dec 7 18:49:34 2021] DELETE /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 07 18:49:34.917085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:34.917715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:34.925329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:34.925787 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:34.926603 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:34.927036 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:35.058956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:35.060383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:35.066835 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:35.067280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:35.068139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:35.068503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:35.109084 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:35.119839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:35.121489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:35.122788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-81d57ef5-4406-45dc-b98c-03eb271bd9e7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.209583 Dec 07 18:49:35.123433 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 398/772] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:34 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:35.144994 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:35.145609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:35.151648 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:35.152123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:35.153214 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:35.153298 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:35.211741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:35.221056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-de85d200-731d-4d86-b306-3275cf2f4a02 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1675 microversion: 2.1 time: 0.166350 Dec 07 18:49:35.221639 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 375/773] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:35 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:35.293727 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:35.301583 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2557610e-627a-42b3-a5c6-1de062354b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.161092 Dec 07 18:49:35.302182 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 399/774] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:35 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:36.142017 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:36.142612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:36.148781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:36.149223 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:36.150007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:36.150437 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:36.239063 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:36.239671 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:36.246070 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:36.246513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:36.247280 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:36.247705 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:36.281640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:36.289368 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:36.290899 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:36.292046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e22149fb-46bc-4e12-ac06-31379c6a7422 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.154308 Dec 07 18:49:36.292612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 376/775] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:36 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:36.318453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:36.319000 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:36.324816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:36.325265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:36.326059 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:36.326821 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:36.383797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:36.392144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-361e213a-2cc5-469e-a5a4-590063fca078 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1675 microversion: 2.1 time: 0.156695 Dec 07 18:49:36.392835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 400/776] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:36 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:36.469967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:36.477195 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2f5af322-e816-4808-a06a-9331186daff6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.162508 Dec 07 18:49:36.477829 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 377/777] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:36 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:37.310542 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:37.311296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:37.318687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:37.319250 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:37.320122 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:37.320832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:37.331208 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-bb906b5d-ea5c-479e-b638-11850f869980 req-410ffd94-c7ae-42e0-8dea-c2fa9502401f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "668cc429-6322-4b0b-8f3a-6d910c891444", "name": "network-vif-deleted", "tag": "74f0e008-eb9a-47c1-abf0-a78d47978293"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:37.332838 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:49:37.332838 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:49:37.340186 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bb906b5d-ea5c-479e-b638-11850f869980 req-410ffd94-c7ae-42e0-8dea-c2fa9502401f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:37.340759 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bb906b5d-ea5c-479e-b638-11850f869980 req-410ffd94-c7ae-42e0-8dea-c2fa9502401f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:37.352523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-bb906b5d-ea5c-479e-b638-11850f869980 req-410ffd94-c7ae-42e0-8dea-c2fa9502401f service nova] Creating event network-vif-deleted:74f0e008-eb9a-47c1-abf0-a78d47978293 for instance 668cc429-6322-4b0b-8f3a-6d910c891444 on hv-cinder-81969 Dec 07 18:49:37.357560 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-bb906b5d-ea5c-479e-b638-11850f869980 req-410ffd94-c7ae-42e0-8dea-c2fa9502401f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030759 Dec 07 18:49:37.358315 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 378/778] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:49:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:49:37.411926 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:37.413186 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:37.424364 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:37.425168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:37.426493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:37.427150 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:37.495808 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:37.505622 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:37.507937 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:37.509404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-df3b5746-0d0b-47b4-9460-d4ac7f2f658b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.202665 Dec 07 18:49:37.510296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 401/779] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:37 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:37.519444 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:37.519444 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:37.523842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:37.524484 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:37.526468 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:37.527936 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:37.531842 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:37.542319 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a0f9241c-1213-4b65-a771-c85292844244 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1608 microversion: 2.1 time: 0.136843 Dec 07 18:49:37.542909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 379/780] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:37 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1608 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:37.694733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:37.702865 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6fca112e-f974-46fe-8989-d8b4cc408578 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.190738 Dec 07 18:49:37.703542 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 402/781] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:37 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:38.528387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:38.529070 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:38.536876 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:38.537323 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:38.538263 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:38.538570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:38.560943 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:38.562798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:38.568990 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:38.569565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:38.570516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:38.571083 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:38.610695 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:38.611465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:38.611852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lazy-loading 'fault' on Instance uuid 668cc429-6322-4b0b-8f3a-6d910c891444 {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:49:38.659205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:38.669933 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1866b453-8907-4437-8729-c7c26229cbec tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1328 microversion: 2.1 time: 0.112602 Dec 07 18:49:38.670672 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 403/782] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:38 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:38.709350 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:38.719523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:38.720945 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:38.721216 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:38.721699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:38.722557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1512a548-4750-4683-a305-452d1cb7cd0d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.197897 Dec 07 18:49:38.723663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 380/783] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:38 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:38.728593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:38.729046 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:38.729868 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:38.730333 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:38.894459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:38.902066 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d16040a5-1778-4074-9b7e-b5638736a491 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.185702 Dec 07 18:49:38.902653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 404/784] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:38 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:39.688481 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:39.689056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:39.695307 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:39.695756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:39.696527 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:39.696962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:39.728351 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:39.728811 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:39.729252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lazy-loading 'fault' on Instance uuid 668cc429-6322-4b0b-8f3a-6d910c891444 {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:49:39.745278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:39.745878 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:39.752698 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:39.753139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:39.753929 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:39.754357 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:39.768352 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:39.775551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-02bfe455-b725-47df-8938-0a1150b207cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 200 len: 1328 microversion: 2.1 time: 0.090889 Dec 07 18:49:39.776128 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 381/785] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:39 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:39.887720 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:39.895894 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:39.897368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:39.898525 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-df88d058-1b22-4d98-9f36-7397da5d6f7d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.156891 Dec 07 18:49:39.899080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 405/786] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:39 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:49:39.919702 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:39.920301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:39.926459 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:39.926901 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:39.927661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:39.928089 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:40.067555 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:40.074803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-459da831-6442-4ae4-97c0-c12f433b816e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.158719 Dec 07 18:49:40.075365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 382/787] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:39 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:40.793259 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:40.793849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:40.800878 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:40.801330 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:40.802130 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:40.802558 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:40.816390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] HTTP exception thrown: Instance 668cc429-6322-4b0b-8f3a-6d910c891444 could not be found. Dec 07 18:49:40.816984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Returning 404 to user: Instance 668cc429-6322-4b0b-8f3a-6d910c891444 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:49:40.817799 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1cb91164-bda5-4e21-91ab-7106e648b669 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 404 len: 111 microversion: 2.1 time: 0.028228 Dec 07 18:49:40.818697 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 406/788] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:40 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:49:40.827733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a99a7bc1-d361-43dd-959d-49b290f8a97b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '.version_select at 0x7f1998109f70>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:40.846888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a99a7bc1-d361-43dd-959d-49b290f8a97b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643992554" status: 202 len: 0 microversion: 2.1 time: 0.023747 Dec 07 18:49:40.847612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 383/789] 10.222.0.41 () {58 vars in 1220 bytes} [Tue Dec 7 18:49:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643992554 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:49:40.916592 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:40.917416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:40.923755 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:40.924478 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:40.925265 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:40.925696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:41.093366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:41.094362 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:41.111985 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:41.112728 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:41.113894 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:41.114511 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:41.147363 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:41.156470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:41.159756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:41.164761 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2a533ff3-5241-453a-984c-b3ba742839ed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.251756 Dec 07 18:49:41.168684 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 407/790] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:40 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:49:41.668448 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:41.677280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9a0a5198-48d6-46fb-9ab1-3d006842534e tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.588033 Dec 07 18:49:41.677871 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 384/791] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:41 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:42.070756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0c41a390-c9f9-4ac4-9a7c-92ef785f4646 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'create', calling method: .version_select at 0x7f198bf97ee0>, body: {"keypair": {"name": "tempest-keypair-1207875598"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:42.083878 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-0c41a390-c9f9-4ac4-9a7c-92ef785f4646 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:49:42.087660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-0c41a390-c9f9-4ac4-9a7c-92ef785f4646 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for user 87d73e143d814bd6b6b09961603410b9 and project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:49:42.184411 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:42.185133 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:42.194392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:42.194847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:42.195622 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:42.196055 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:42.228523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-0c41a390-c9f9-4ac4-9a7c-92ef785f4646 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:49:42.234075 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-0c41a390-c9f9-4ac4-9a7c-92ef785f4646 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for user 87d73e143d814bd6b6b09961603410b9 and project cbb0144e924847109e6a254192f1e6bd. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:49:42.250267 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0c41a390-c9f9-4ac4-9a7c-92ef785f4646 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.282801 Dec 07 18:49:42.251334 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 408/792] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Dec 7 18:49:41 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:42.354667 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:42.365518 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:42.367087 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:42.368197 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b61db13d-557b-4a92-9d8f-615fad2a708d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.187748 Dec 07 18:49:42.368748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 385/793] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:42 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:49:42.694661 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:42.695346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:42.701492 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:42.702963 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:42.703770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:42.704220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:42.911736 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:42.919109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9ad21867-a275-4fc8-9421-f3a5477f3247 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.228302 Dec 07 18:49:42.919683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 409/794] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:42 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:43.387403 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:43.388292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:43.402559 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:43.403038 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:43.403839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:43.404266 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:43.543778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:43.552909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:43.554909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:43.556111 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7d4c2af5-683c-4cbc-8402-55cebed8a4eb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.172921 Dec 07 18:49:43.556703 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 386/795] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:43 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:43.802493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1538044719", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a321d8bd-fce1-4a8d-9656-239d82555545"}], "security_groups": [{"name": "tempest-securitygroup--784173222"}], "key_name": "tempest-keypair-1207875598", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:43.903031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] validate_networks() for [('a321d8bd-fce1-4a8d-9656-239d82555545', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:49:43.937407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:43.938053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:43.943744 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:43.944192 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:43.944968 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:43.945406 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:44.078573 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:44.085887 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6e67b374-3415-4a5d-951a-3d104693f159 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.152804 Dec 07 18:49:44.086996 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 387/796] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:43 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:44.308851 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:49:44.309274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:49:44.309743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:49:44.310192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:49:44.310599 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:49:44.319225 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:44.319669 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:44.320467 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:44.320903 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:44.337305 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for project cbb0144e924847109e6a254192f1e6bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:49:44.341141 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Getting quotas for user 87d73e143d814bd6b6b09961603410b9 and project cbb0144e924847109e6a254192f1e6bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:49:44.352189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:49:44.354486 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:49:44.401592 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2750a352-4ae6-43ac-bb6f-969568784ab8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.603145 Dec 07 18:49:44.402868 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 410/797] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:49:43 2021] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:49:44.415795 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f6c14808-38f4-47ea-b853-34528c47bf95 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:44.415795 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f6c14808-38f4-47ea-b853-34528c47bf95 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:44.470074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f6c14808-38f4-47ea-b853-34528c47bf95 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:44.477762 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f6c14808-38f4-47ea-b853-34528c47bf95 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1238 microversion: 2.1 time: 0.068704 Dec 07 18:49:44.478654 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 388/798] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:44 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:44.574590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:44.575459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:44.582043 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:44.582687 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:44.583459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:44.583890 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:44.753644 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:44.763973 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:44.766602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:44.767858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5cf5f40e-1299-4cf1-9737-40c86f414b0f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.196905 Dec 07 18:49:44.768499 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 411/799] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:44 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:45.104672 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:45.105395 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:45.111680 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:45.112375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:45.113160 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:45.113750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:45.495408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:45.496085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:45.507274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:45.507797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:45.512459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:45.515235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:45.535436 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:45.544334 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-43111645-e8ce-454a-ad69-828fad6e5e92 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.444051 Dec 07 18:49:45.546845 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 389/800] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:45 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:45.607005 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:45.616412 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-126c76cb-896e-4363-83b2-29b27b7bd179 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1290 microversion: 2.1 time: 0.125154 Dec 07 18:49:45.622934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 412/801] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:45 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1290 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:45.786964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:45.787657 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:45.794350 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:45.794938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:45.796385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:45.797567 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:46.119528 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:46.128596 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:46.130736 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:46.132078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3847a4c1-14e0-47eb-bb03-f9db8acfe987 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 200 len: 1725 microversion: 2.20 time: 0.349190 Dec 07 18:49:46.132813 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 390/802] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:45 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:49:46.505181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-ba8b89f0-7827-4c92-b2d7-85c165f65902 req-5a95ba89-07ea-4338-a495-db5ffd7d46f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54d910a-30a1-4aa9-a038-6dafd95bfa5c", "name": "network-vif-deleted", "tag": "5d954230-64a1-4c4f-91f6-8893ea16dc4a"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:46.506827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:49:46.506827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:49:46.514969 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-ba8b89f0-7827-4c92-b2d7-85c165f65902 req-5a95ba89-07ea-4338-a495-db5ffd7d46f9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:46.518726 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-ba8b89f0-7827-4c92-b2d7-85c165f65902 req-5a95ba89-07ea-4338-a495-db5ffd7d46f9 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:46.543990 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-ba8b89f0-7827-4c92-b2d7-85c165f65902 req-5a95ba89-07ea-4338-a495-db5ffd7d46f9 service nova] Creating event network-vif-deleted:5d954230-64a1-4c4f-91f6-8893ea16dc4a for instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c on hv-cinder-81969 Dec 07 18:49:46.556660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-ba8b89f0-7827-4c92-b2d7-85c165f65902 req-5a95ba89-07ea-4338-a495-db5ffd7d46f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127615 Dec 07 18:49:46.557459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 413/803] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:49:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:49:46.563904 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:46.564509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:46.586391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:46.586844 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:46.587852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:46.588457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:46.643577 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:46.644766 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:46.660352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:46.663210 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:46.666058 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:46.667761 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:46.880170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:46.888035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b310cdb5-35ce-4855-a940-9b350e7dd8bc tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.327733 Dec 07 18:49:46.889282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 391/804] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:46 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:47.015097 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:47.022485 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a8d6c96f-fa9d-430a-8993-71c07c390f9b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.383329 Dec 07 18:49:47.035132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 414/805] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:46 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:47.154018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:47.158499 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:47.171706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:47.173523 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:47.175518 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:47.176817 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:47.202844 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] HTTP exception thrown: Instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c could not be found. Dec 07 18:49:47.210759 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Returning 404 to user: Instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:49:47.211962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-324e8816-c1e8-4df8-9ddb-fa985297a762 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 404 len: 111 microversion: 2.20 time: 0.064451 Dec 07 18:49:47.213163 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 392/806] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:47 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 07 18:49:47.223051 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7cca66af-caf9-45a8-9343-c1417f3bf937 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '.version_select at 0x7f198bf53790>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:47.254516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7cca66af-caf9-45a8-9343-c1417f3bf937 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022890137" status: 204 len: 0 microversion: 2.20 time: 0.035735 Dec 07 18:49:47.256701 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 415/807] 10.222.0.41 () {60 vars in 1261 bytes} [Tue Dec 7 18:49:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022890137 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 07 18:49:47.537433 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-f7119d36-2715-4558-a2b1-94ea2dfbb22f req-051b8ba8-e4e1-4e91-a608-7c8582b14dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0223b4da-cb69-4ac7-834e-04eb11b904fa", "tag": "c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:47.539565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:49:47.539565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:49:47.556834 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-f7119d36-2715-4558-a2b1-94ea2dfbb22f req-051b8ba8-e4e1-4e91-a608-7c8582b14dec service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:47.558292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-f7119d36-2715-4558-a2b1-94ea2dfbb22f req-051b8ba8-e4e1-4e91-a608-7c8582b14dec service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:47.575034 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-f7119d36-2715-4558-a2b1-94ea2dfbb22f req-051b8ba8-e4e1-4e91-a608-7c8582b14dec service nova] Creating event network-changed:c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b for instance 0223b4da-cb69-4ac7-834e-04eb11b904fa on hv-cinder-81969 Dec 07 18:49:47.584636 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-f7119d36-2715-4558-a2b1-94ea2dfbb22f req-051b8ba8-e4e1-4e91-a608-7c8582b14dec service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052420 Dec 07 18:49:47.585764 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 393/808] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:49:47.907298 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:47.909483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:47.928060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:47.928745 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:47.929764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:47.931848 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:48.067509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:48.079633 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:48.101297 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:48.103733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:48.109226 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:48.110030 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:48.343771 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:48.360092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-10ffdff1-34c1-40dd-b451-59aeb6685b32 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.458108 Dec 07 18:49:48.360684 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 416/809] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:47 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:48.398222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:48.411317 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9eacb6a9-042b-48bf-ac87-afe4797f129a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.372307 Dec 07 18:49:48.412001 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 394/810] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:48 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:48.435633 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-84a4c406-8fe4-4dec-9057-f5a54734811c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'create', calling method: .version_select at 0x7f198bffe0d0>, body: {"keypair": {"name": "tempest-keypair-1054595563"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:48.450308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-84a4c406-8fe4-4dec-9057-f5a54734811c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:49:48.455919 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-84a4c406-8fe4-4dec-9057-f5a54734811c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for user 70351b4675ab4d3690f6b5565dedd3c4 and project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:49:48.591865 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-84a4c406-8fe4-4dec-9057-f5a54734811c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:49:48.596160 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-84a4c406-8fe4-4dec-9057-f5a54734811c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for user 70351b4675ab4d3690f6b5565dedd3c4 and project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'key_pairs'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:49:48.609055 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-84a4c406-8fe4-4dec-9057-f5a54734811c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.177224 Dec 07 18:49:48.609664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 417/811] 10.222.0.41 () {62 vars in 1198 bytes} [Tue Dec 7 18:49:48 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 178 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 07 18:49:49.028116 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:49.028641 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:49.036144 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.036599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.037376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.037806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.120077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lazy-loading 'services' on Instance uuid 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:49:49.194594 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-150a4452-a896-4dee-aa75-73568fa9054f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd/os-volume_attachments/9a3cdf5f-b2db-45e1-a8cd-b18f344471cb" status: 202 len: 0 microversion: 2.1 time: 0.169976 Dec 07 18:49:49.195195 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 395/812] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:49:49 2021] DELETE /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd/os-volume_attachments/9a3cdf5f-b2db-45e1-a8cd-b18f344471cb => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:49:49.378247 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:49.378838 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:49.384650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.385100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.385883 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.386340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.430297 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:49.431012 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:49.438521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.438976 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.439776 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.440248 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.528971 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:49.537159 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d423a86e-e0b1-457f-a8a8-9f108fa640a8 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1510 microversion: 2.1 time: 0.163653 Dec 07 18:49:49.537735 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 418/813] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:49 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:49.553957 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-99388521-da84-44d1-bc2f-3153fc54187b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:49.554637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-99388521-da84-44d1-bc2f-3153fc54187b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:49.560622 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99388521-da84-44d1-bc2f-3153fc54187b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.561152 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99388521-da84-44d1-bc2f-3153fc54187b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.562050 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99388521-da84-44d1-bc2f-3153fc54187b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.562526 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-99388521-da84-44d1-bc2f-3153fc54187b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.654087 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-99388521-da84-44d1-bc2f-3153fc54187b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "POST /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d/action" status: 202 len: 0 microversion: 2.1 time: 0.103911 Dec 07 18:49:49.658621 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 419/814] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:49:49 2021] POST /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:49:49.663436 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:49.664088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:49.672862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.673391 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.674544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:49.675223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:49.678632 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:49.688621 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b9aa08c2-1919-46ca-b579-33521262b26b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.262429 Dec 07 18:49:49.689203 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 396/815] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:49 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:49.841882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:49.851699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f5753b0b-3c20-4e83-8856-73333fbc4683 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1518 microversion: 2.1 time: 0.191972 Dec 07 18:49:49.852884 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 420/816] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:49 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:50.318922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:50.319438 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:50.325521 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.326010 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.326831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.327264 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.339088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1404445090", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9d18908e-4fa9-4515-9ad2-63e91916c83c"}], "security_groups": [{"name": "tempest-securitygroup--1413836383"}], "key_name": "tempest-keypair-1054595563", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:50.352401 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:49:50.449837 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-384b6505-072c-4fca-8513-63aaf281c96d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 204 len: 0 microversion: 2.1 time: 0.134295 Dec 07 18:49:50.450645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 397/817] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:49:50 2021] DELETE /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 07 18:49:50.455918 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] validate_networks() for [('9d18908e-4fa9-4515-9ad2-63e91916c83c', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:49:50.460201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:50.461164 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:50.467538 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.468492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.469563 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.470119 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.628429 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:50.635777 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b22cdfaa-14b9-4849-9ebe-13161353e4bb tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1512 microversion: 2.1 time: 0.180567 Dec 07 18:49:50.636274 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 398/818] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:50 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:50.649574 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-bde9cc64-b828-4b56-8ce1-3e965e2da308 req-c6643d03-6f18-422f-80e9-4b37cc7078ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6353ff89-98cf-4e56-b677-b0f9431d7e1d", "name": "network-vif-unplugged", "status": "completed", "tag": "ea0e7445-57e1-4ed8-b96b-ef483e19d0bd"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:50.651262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:49:50.651262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:49:50.659608 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bde9cc64-b828-4b56-8ce1-3e965e2da308 req-c6643d03-6f18-422f-80e9-4b37cc7078ef service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.660058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bde9cc64-b828-4b56-8ce1-3e965e2da308 req-c6643d03-6f18-422f-80e9-4b37cc7078ef service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.671419 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.compute.server_external_events [req-bde9cc64-b828-4b56-8ce1-3e965e2da308 req-c6643d03-6f18-422f-80e9-4b37cc7078ef service nova] Unable to find a host for instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d. Dropping event network-vif-unplugged {{(pid=122586) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 07 18:49:50.672307 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-bde9cc64-b828-4b56-8ce1-3e965e2da308 req-c6643d03-6f18-422f-80e9-4b37cc7078ef service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029027 Dec 07 18:49:50.673063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 399/819] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:49:50 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 07 18:49:50.705643 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:50.706267 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:50.712052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.712502 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.713479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.713957 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.859395 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:50.867165 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5b37e70d-d5ed-411a-afab-1bb4203c33b1 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.165683 Dec 07 18:49:50.867833 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 400/820] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:50 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:50.874670 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:50.875466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:50.881801 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.882552 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.883347 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.883986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.908127 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:49:50.908550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:49:50.909018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:49:50.909418 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:49:50.909824 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:49:50.918355 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.918796 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.919783 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:50.920212 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:50.938654 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:49:50.942918 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Getting quotas for user 70351b4675ab4d3690f6b5565dedd3c4 and project 2417a4b6b8b04e738fe57f1c882d88bc. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:49:50.954300 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:49:50.956625 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:49:51.004941 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9721fdf1-f923-41f3-ad25-8005995c0714 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.669814 Dec 07 18:49:51.005765 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 421/821] 10.222.0.41 () {62 vars in 1187 bytes} [Tue Dec 7 18:49:50 2021] POST /compute/v2.1/servers => generated 402 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 07 18:49:51.015379 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dcc2f30f-0d2a-43de-bcb8-bc08ced6ce4d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:51.015992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dcc2f30f-0d2a-43de-bcb8-bc08ced6ce4d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:51.034342 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:51.042533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a62f5e71-8764-4160-9012-fe473989a4b4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.173456 Dec 07 18:49:51.043108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 401/822] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:50 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:51.075513 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dcc2f30f-0d2a-43de-bcb8-bc08ced6ce4d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:51.083373 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dcc2f30f-0d2a-43de-bcb8-bc08ced6ce4d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:51.084872 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dcc2f30f-0d2a-43de-bcb8-bc08ced6ce4d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:51.085979 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dcc2f30f-0d2a-43de-bcb8-bc08ced6ce4d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1282 microversion: 2.20 time: 0.074512 Dec 07 18:49:51.086545 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 422/823] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:51 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:49:51.653396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:51.654047 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:51.662713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:51.663455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:51.665324 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:51.665762 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:51.814029 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:51.821517 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2fa73243-4d0e-4cb1-a9a9-c136fa24010a tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1512 microversion: 2.1 time: 0.171731 Dec 07 18:49:51.822107 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 402/824] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:51 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:51.883995 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:51.884635 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:51.891625 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:51.892080 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:51.892854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:51.893285 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.035714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:52.042988 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-30572546-d6cd-41fb-a7e1-c59969b972d7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.162645 Dec 07 18:49:52.043880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 423/825] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:51 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:52.060565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:52.061219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:52.067178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:52.067629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.068708 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:52.069237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.105395 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:52.106800 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:52.115564 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:52.116374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.119631 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:52.120259 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.211026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:52.220248 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:52.222189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:52.223877 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-97f7161d-9956-4778-b3b3-7a460ede1ced tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1352 microversion: 2.20 time: 0.123488 Dec 07 18:49:52.224707 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 424/826] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:52 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:49:52.246816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:52.255170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-aad85e69-c0e4-4098-a779-d98e71ce54e6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.198298 Dec 07 18:49:52.255738 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 403/827] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:52 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:52.827731 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-80c5a8fe-57ab-4908-a82e-52155aa5bc1c req-1dbc4287-8bb5-4020-9387-88e2e9d1db59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd55682-7fc8-4b23-b5f8-0bb90865a2cd", "name": "network-vif-deleted", "tag": "804851cf-f4a4-40c0-a158-517510794afb"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:52.829900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:49:52.829900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:49:52.839783 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:52.840646 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:52.854942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:52.855803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.856976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-80c5a8fe-57ab-4908-a82e-52155aa5bc1c req-1dbc4287-8bb5-4020-9387-88e2e9d1db59 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:52.858484 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:52.859313 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-80c5a8fe-57ab-4908-a82e-52155aa5bc1c req-1dbc4287-8bb5-4020-9387-88e2e9d1db59 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.860290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:52.892541 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-80c5a8fe-57ab-4908-a82e-52155aa5bc1c req-1dbc4287-8bb5-4020-9387-88e2e9d1db59 service nova] Creating event network-vif-deleted:804851cf-f4a4-40c0-a158-517510794afb for instance 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd on hv-cinder-81969 Dec 07 18:49:52.904505 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-80c5a8fe-57ab-4908-a82e-52155aa5bc1c req-1dbc4287-8bb5-4020-9387-88e2e9d1db59 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081803 Dec 07 18:49:52.905691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 425/828] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:49:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:49:52.952909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:52.962268 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8772eb86-2182-42de-902b-855cbee07a6d tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 200 len: 1304 microversion: 2.1 time: 0.125690 Dec 07 18:49:52.963496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 404/829] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:52 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:53.061725 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:53.062476 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:53.069492 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.070237 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:53.071245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.071679 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:53.241299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:53.242201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:53.248126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.248750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:53.250320 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.250753 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:53.399388 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:53.408012 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:53.409505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:53.410658 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-521c691b-1202-46ed-b851-62cfd5e77f9e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.173108 Dec 07 18:49:53.411455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 405/830] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:53 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:49:53.415722 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:53.416538 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:53.424484 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.424935 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:53.425969 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.426565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:53.559910 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:53.566751 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:53.568700 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b4e39527-b526-4aa1-b4a7-b732fcd422b7 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.511580 Dec 07 18:49:53.569385 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 426/831] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:53 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:53.574230 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4b3028fa-665a-40cf-bb26-ad67d49c9b50 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.161745 Dec 07 18:49:53.574797 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 406/832] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:53 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:53.980803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:53.981445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:53.995859 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.996682 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:53.997727 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:53.998434 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.015281 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] HTTP exception thrown: Instance 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd could not be found. Dec 07 18:49:54.016564 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Returning 404 to user: Instance 5bd55682-7fc8-4b23-b5f8-0bb90865a2cd could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:49:54.017740 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-28e22695-1e3c-46af-b413-e98afcebb264 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd" status: 404 len: 111 microversion: 2.1 time: 0.040854 Dec 07 18:49:54.018848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 407/833] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:53 2021] GET /compute/v2.1/servers/5bd55682-7fc8-4b23-b5f8-0bb90865a2cd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:49:54.078640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-aea5960a-a75c-4304-9486-e3f5f682fd44 req-b3023c31-fe55-4832-a3d6-8f8dd9c61525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017abb4f-1da1-4373-83da-f4e5b0d2516b", "tag": "9d321fb6-c496-4034-a6c7-7c7410c908b0"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:54.080201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:49:54.080201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:49:54.088099 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-aea5960a-a75c-4304-9486-e3f5f682fd44 req-b3023c31-fe55-4832-a3d6-8f8dd9c61525 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:54.088540 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-aea5960a-a75c-4304-9486-e3f5f682fd44 req-b3023c31-fe55-4832-a3d6-8f8dd9c61525 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.100220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-aea5960a-a75c-4304-9486-e3f5f682fd44 req-b3023c31-fe55-4832-a3d6-8f8dd9c61525 service nova] Creating event network-changed:9d321fb6-c496-4034-a6c7-7c7410c908b0 for instance 017abb4f-1da1-4373-83da-f4e5b0d2516b on hv-cinder-81969 Dec 07 18:49:54.104820 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-aea5960a-a75c-4304-9486-e3f5f682fd44 req-b3023c31-fe55-4832-a3d6-8f8dd9c61525 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212319 Dec 07 18:49:54.105421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 427/834] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:49:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:49:54.429582 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:54.430375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:54.437371 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:54.437827 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.438624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:54.439051 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.571625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:54.579135 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:54.580626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:54.581732 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b6cf584a-38d8-4fbf-a460-ee3401ae7923 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.155885 Dec 07 18:49:54.582306 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 408/835] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:54 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:54.586376 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:54.587098 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:54.593559 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:54.594188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:54.594390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:54.594837 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.595686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:54.596058 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.599840 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:54.600293 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.601072 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:54.601508 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:54.731694 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:54.735361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:54.740249 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-67bb20a9-4bc8-4413-953b-efe0f11b2946 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.157783 Dec 07 18:49:54.740832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 428/836] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:54 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:54.742914 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6fa87fe5-5438-4210-a4c2-d92693583da3 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.153540 Dec 07 18:49:54.743470 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 409/837] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:54 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:55.599107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:55.599706 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:55.605835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:55.606337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:55.607092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:55.607518 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:55.736775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:55.744339 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:55.745817 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:55.746959 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3c2df208-7284-4548-910b-5c8b238afe66 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.151582 Dec 07 18:49:55.747518 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 429/838] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:55 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:55.756663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:55.757282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:55.759416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:55.760024 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:55.763699 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:55.764204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:55.765256 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:55.765692 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:55.765858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:55.766337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:55.767101 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:55.767531 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:55.906335 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:55.907778 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:55.913658 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-eb8b4a89-0bf5-4dd2-add4-6a70857bb470 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.161018 Dec 07 18:49:55.914258 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 410/839] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:55 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:55.915162 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6a3fdffd-d36e-41e4-a9a0-6264934f8be6 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.160058 Dec 07 18:49:55.915910 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 430/840] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:55 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:56.321249 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-20d57944-4d17-43a7-b411-0e294bbddb0b req-4f6793c8-e06f-41fc-93eb-93bfe2d23d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0223b4da-cb69-4ac7-834e-04eb11b904fa", "name": "network-vif-plugged", "status": "completed", "tag": "c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:49:56.322847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:49:56.322847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:49:56.330309 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-20d57944-4d17-43a7-b411-0e294bbddb0b req-4f6793c8-e06f-41fc-93eb-93bfe2d23d87 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:56.330754 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-20d57944-4d17-43a7-b411-0e294bbddb0b req-4f6793c8-e06f-41fc-93eb-93bfe2d23d87 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:56.341217 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-20d57944-4d17-43a7-b411-0e294bbddb0b req-4f6793c8-e06f-41fc-93eb-93bfe2d23d87 service nova] Creating event network-vif-plugged:c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b for instance 0223b4da-cb69-4ac7-834e-04eb11b904fa on hv-cinder-81969 Dec 07 18:49:56.346114 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-20d57944-4d17-43a7-b411-0e294bbddb0b req-4f6793c8-e06f-41fc-93eb-93bfe2d23d87 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028487 Dec 07 18:49:56.346702 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 411/841] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:49:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:49:56.765341 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:56.765952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:56.772181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:56.772620 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:56.773376 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:56.773799 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:56.902185 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:56.910193 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:56.911693 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:56.912789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-de93a403-2515-4e68-9bf1-234e66e206a1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.151958 Dec 07 18:49:56.913358 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 431/842] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:56 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:56.932619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:56.933115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:56.933323 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:56.933520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:56.939858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:56.940065 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:56.940303 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:56.940671 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:56.941076 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:56.941364 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:56.941488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:56.941800 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:57.073180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:57.075228 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:57.080985 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9b7a304c-764d-41f0-9078-dc82998c8c5b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.153054 Dec 07 18:49:57.081562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 412/843] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:56 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:57.083020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-168ef847-c989-4efb-a232-67abbae040ae tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.153368 Dec 07 18:49:57.083606 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 432/844] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:56 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:57.931111 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:57.931754 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:57.938704 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:57.939236 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:57.939905 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:57.940329 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:58.068949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:58.076576 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:58.078088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:58.079178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0a8a9853-b18e-495b-96c1-943df991dd9a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.151799 Dec 07 18:49:58.079733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 413/845] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:57 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:58.097935 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:58.098595 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:58.099351 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:58.100015 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:58.104916 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:58.105370 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:58.105559 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:58.106109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:58.106220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:58.106591 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:58.106873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:58.107296 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:58.243516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:58.243816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:58.251692 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5fe36a06-3246-40c5-9053-1576a79ce3bf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1363 microversion: 2.1 time: 0.157370 Dec 07 18:49:58.251836 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d8ce5838-09e2-4312-8b52-d0118dc841e4 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.156009 Dec 07 18:49:58.255419 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 414/847] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:58 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:58.255734 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 433/847] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:58 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:59.096483 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:59.097058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:59.103251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.103706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.104481 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.104915 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.245984 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:59.254121 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:59.255766 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:59.256966 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e20294f0-ffa4-4b56-9d71-6f0e0553540e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.164278 Dec 07 18:49:59.257530 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 415/848] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:49:59 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:49:59.269315 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:59.269978 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:59.276422 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.276866 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.277693 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.278025 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:59.278163 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.278636 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:59.285561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.286062 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.286845 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.287272 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.437806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:59.438151 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:49:59.445251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ae56b986-829b-4505-b6b5-147521313db9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1550 microversion: 2.1 time: 0.171323 Dec 07 18:49:59.446368 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a872201e-d6ca-40bc-b6c3-765513f31b69 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.180978 Dec 07 18:49:59.447385 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 434/849] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:59 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:49:59.450564 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 416/850] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:49:59 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:49:59.464618 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9eeaebc0-bdf2-4f55-bf39-2e7efb48a22a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:49:59.465021 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9eeaebc0-bdf2-4f55-bf39-2e7efb48a22a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:49:59.471835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9eeaebc0-bdf2-4f55-bf39-2e7efb48a22a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.472407 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9eeaebc0-bdf2-4f55-bf39-2e7efb48a22a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.473850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9eeaebc0-bdf2-4f55-bf39-2e7efb48a22a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:49:59.474897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9eeaebc0-bdf2-4f55-bf39-2e7efb48a22a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:49:59.568409 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9eeaebc0-bdf2-4f55-bf39-2e7efb48a22a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109500 Dec 07 18:49:59.569216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 435/851] 10.222.0.41 () {58 vars in 1274 bytes} [Tue Dec 7 18:49:59 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:00.275806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:00.276400 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:00.283447 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:00.283897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:00.284678 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:00.285109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:00.419421 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:00.430063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:00.431713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:00.432994 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-78936823-6ea4-432d-bd95-17d25334d9f8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.160935 Dec 07 18:50:00.433557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 417/852] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:50:00 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:50:00.468632 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:00.469238 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:00.475012 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:00.475454 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:00.476217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:00.476641 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:00.535247 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-939a2ebb-a418-4853-bb53-c22e327f7b6c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:00.536346 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-939a2ebb-a418-4853-bb53-c22e327f7b6c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:00.542519 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-939a2ebb-a418-4853-bb53-c22e327f7b6c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:00.543054 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-939a2ebb-a418-4853-bb53-c22e327f7b6c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:00.543846 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-939a2ebb-a418-4853-bb53-c22e327f7b6c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:00.544278 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-939a2ebb-a418-4853-bb53-c22e327f7b6c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:00.630218 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:00.637793 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6b51046f-caa4-4f70-a4c3-197ccd42ea7d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.173798 Dec 07 18:50:00.638393 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 436/853] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:00 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:00.643522 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-af1163fc-5111-4922-bd19-3086c90039d5 req-e1f39e08-a4e0-46b1-802d-5d40a0be5bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0223b4da-cb69-4ac7-834e-04eb11b904fa", "tag": "c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:00.646273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:50:00.646273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:50:00.653064 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-af1163fc-5111-4922-bd19-3086c90039d5 req-e1f39e08-a4e0-46b1-802d-5d40a0be5bbe service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:00.653607 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-af1163fc-5111-4922-bd19-3086c90039d5 req-e1f39e08-a4e0-46b1-802d-5d40a0be5bbe service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:00.665045 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-af1163fc-5111-4922-bd19-3086c90039d5 req-e1f39e08-a4e0-46b1-802d-5d40a0be5bbe service nova] Creating event network-changed:c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b for instance 0223b4da-cb69-4ac7-834e-04eb11b904fa on hv-cinder-81969 Dec 07 18:50:00.669990 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-af1163fc-5111-4922-bd19-3086c90039d5 req-e1f39e08-a4e0-46b1-802d-5d40a0be5bbe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030338 Dec 07 18:50:00.671299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 437/854] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:50:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:01.451204 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:01.452040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:01.458307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:01.458911 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:01.459751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:01.460243 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:01.602694 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:01.611430 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:01.613018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:01.614311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4c711210-2566-4a72-8564-768e7bcccb65 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.167135 Dec 07 18:50:01.614884 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 438/855] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:50:01 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:50:01.655447 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:01.656071 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:01.662321 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:01.662772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:01.663554 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:01.663986 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:01.809002 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:01.818496 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-96310f2e-e7a7-40ad-931b-816f2f395168 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.167437 Dec 07 18:50:01.819081 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 439/856] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:01 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:50:02.517902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-939a2ebb-a418-4853-bb53-c22e327f7b6c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 1.986634 Dec 07 18:50:02.518619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 418/857] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:00 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 07 18:50:02.632958 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:02.634522 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:02.645344 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:02.646470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:02.647371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:02.648553 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:02.798863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-726377068", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "63fc2b78-f69b-4eb4-88bc-0e61b27ee4f8"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:02.859172 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] validate_networks() for [('63fc2b78-f69b-4eb4-88bc-0e61b27ee4f8', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:50:02.888981 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:02.896815 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:02.899903 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:02.902042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8d135907-353c-4e61-8c4a-06f5cf52dbe7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.272564 Dec 07 18:50:02.913035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 440/858] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:50:02 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:50:02.917071 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:02.917874 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:02.926446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:02.926888 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:02.927671 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:02.928100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:03.181231 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:03.189729 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-31b1d986-8b09-440e-b78f-dbdc8c5e23bb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.282597 Dec 07 18:50:03.190340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 441/859] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:02 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:03.313240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:50:03.313668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:50:03.314177 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:50:03.314586 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:50:03.314995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:50:03.323516 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:03.323963 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:03.324770 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:03.325204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:03.342850 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Getting quotas for project 103d606fa1a54ad8993058e83b59a30c. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:50:03.346883 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Getting quotas for user 3533bdc77e13492cb30ede2634402c48 and project 103d606fa1a54ad8993058e83b59a30c. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:50:03.357225 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:50:03.360505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:50:03.402922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-23409bb8-31ba-47c3-aa47-b5bdc5ba4744 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612040 Dec 07 18:50:03.403670 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 419/860] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:50:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:50:03.414049 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5b0ff344-fb6d-4862-8370-2d9200752f5c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:03.414743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5b0ff344-fb6d-4862-8370-2d9200752f5c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:03.468139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5b0ff344-fb6d-4862-8370-2d9200752f5c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:03.474770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5b0ff344-fb6d-4862-8370-2d9200752f5c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1218 microversion: 2.1 time: 0.064487 Dec 07 18:50:03.475463 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 442/861] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:03 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:50:03.529053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f45c91ad-89ad-4649-b588-48eca9d3bfd6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:03.530217 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f45c91ad-89ad-4649-b588-48eca9d3bfd6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:03.537246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f45c91ad-89ad-4649-b588-48eca9d3bfd6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:03.537690 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f45c91ad-89ad-4649-b588-48eca9d3bfd6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:03.538501 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f45c91ad-89ad-4649-b588-48eca9d3bfd6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:03.539096 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f45c91ad-89ad-4649-b588-48eca9d3bfd6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:03.601264 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f45c91ad-89ad-4649-b588-48eca9d3bfd6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.075718 Dec 07 18:50:03.601974 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 420/862] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:03 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 07 18:50:03.778842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-a67f09d4-31d1-49e0-aa78-fa28bf118847 req-000067e0-f0d5-4feb-b6bb-f94583a52ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017abb4f-1da1-4373-83da-f4e5b0d2516b", "name": "network-vif-plugged", "status": "completed", "tag": "9d321fb6-c496-4034-a6c7-7c7410c908b0"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:03.780490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:50:03.780490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:50:03.788400 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-a67f09d4-31d1-49e0-aa78-fa28bf118847 req-000067e0-f0d5-4feb-b6bb-f94583a52ddf service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:03.788850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-a67f09d4-31d1-49e0-aa78-fa28bf118847 req-000067e0-f0d5-4feb-b6bb-f94583a52ddf service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:03.800552 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-a67f09d4-31d1-49e0-aa78-fa28bf118847 req-000067e0-f0d5-4feb-b6bb-f94583a52ddf service nova] Creating event network-vif-plugged:9d321fb6-c496-4034-a6c7-7c7410c908b0 for instance 017abb4f-1da1-4373-83da-f4e5b0d2516b on hv-cinder-81969 Dec 07 18:50:03.805477 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-a67f09d4-31d1-49e0-aa78-fa28bf118847 req-000067e0-f0d5-4feb-b6bb-f94583a52ddf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092017 Dec 07 18:50:03.806296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 443/863] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:50:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:03.921402 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:03.922126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:03.930714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:03.931168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:03.931949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:03.932558 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:04.106465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:04.114438 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:04.115956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:04.117078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8976bfda-02aa-4e39-902d-f31fc210d4dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.200281 Dec 07 18:50:04.117643 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 421/864] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:50:03 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:50:04.206623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:04.207347 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:04.213661 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:04.214141 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:04.214910 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:04.215342 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:04.348703 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:04.355971 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-85cc42f5-f74c-43de-9da4-cccad8f2debb tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.153364 Dec 07 18:50:04.356535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 444/865] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:04 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:04.492540 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:04.493072 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:04.502175 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:04.502627 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:04.503405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:04.503835 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:04.565481 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:04.574036 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0032ce52-a331-466b-b463-67cdc9f5ba24 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1270 microversion: 2.1 time: 0.085551 Dec 07 18:50:04.575308 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 422/866] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:04 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:04.614094 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6af9dab9-c5b7-4b7a-8e71-e6444616df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:04.615757 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6af9dab9-c5b7-4b7a-8e71-e6444616df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:04.621778 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6af9dab9-c5b7-4b7a-8e71-e6444616df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:04.622269 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6af9dab9-c5b7-4b7a-8e71-e6444616df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:04.623086 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6af9dab9-c5b7-4b7a-8e71-e6444616df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:04.624722 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6af9dab9-c5b7-4b7a-8e71-e6444616df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:04.694223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6af9dab9-c5b7-4b7a-8e71-e6444616df01 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.083925 Dec 07 18:50:04.697862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 445/867] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:04 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:50:05.135812 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:05.136680 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:05.143682 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.144140 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.144912 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.145341 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.297489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:05.307624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:05.309609 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:05.313552 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-907b1bd4-4afa-45db-8005-8f36c44052b1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1408 microversion: 2.20 time: 0.181271 Dec 07 18:50:05.314560 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 423/868] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:50:05 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:50:05.373627 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:05.374423 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:05.381685 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.382455 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.383252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.383690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.591629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:05.592900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:05.598982 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.599439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.600253 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.600869 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.663433 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:05.673000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6fbf065d-c9e0-4df2-80ea-c7607cb7e792 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.303890 Dec 07 18:50:05.674333 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 446/869] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:05 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:05.705841 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9bb02fce-e179-45cd-beb3-a304b6dedd4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:05.706829 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9bb02fce-e179-45cd-beb3-a304b6dedd4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:05.712852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9bb02fce-e179-45cd-beb3-a304b6dedd4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.713516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9bb02fce-e179-45cd-beb3-a304b6dedd4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.714341 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9bb02fce-e179-45cd-beb3-a304b6dedd4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.714780 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9bb02fce-e179-45cd-beb3-a304b6dedd4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.742106 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:05.749836 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-06d588f0-595c-46bd-8dbb-ea8d6d7040d9 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1318 microversion: 2.1 time: 0.161895 Dec 07 18:50:05.750453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 424/870] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:05 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:05.780804 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9bb02fce-e179-45cd-beb3-a304b6dedd4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.079223 Dec 07 18:50:05.781568 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 447/871] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:05 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 07 18:50:05.824696 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-ab91bd94-c04a-4d9f-ab69-29c05c7ddbd5 req-2a1dbcb5-604c-46f8-99b8-994a29a5ec09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6353ff89-98cf-4e56-b677-b0f9431d7e1d", "name": "network-vif-plugged", "status": "completed", "tag": "ea0e7445-57e1-4ed8-b96b-ef483e19d0bd"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:05.826413 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:50:05.826413 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:50:05.833055 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-ab91bd94-c04a-4d9f-ab69-29c05c7ddbd5 req-2a1dbcb5-604c-46f8-99b8-994a29a5ec09 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:05.833500 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-ab91bd94-c04a-4d9f-ab69-29c05c7ddbd5 req-2a1dbcb5-604c-46f8-99b8-994a29a5ec09 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:05.844969 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-ab91bd94-c04a-4d9f-ab69-29c05c7ddbd5 req-2a1dbcb5-604c-46f8-99b8-994a29a5ec09 service nova] Creating event network-vif-plugged:ea0e7445-57e1-4ed8-b96b-ef483e19d0bd for instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d on hv-cinder-81969 Dec 07 18:50:05.849775 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-ab91bd94-c04a-4d9f-ab69-29c05c7ddbd5 req-2a1dbcb5-604c-46f8-99b8-994a29a5ec09 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028695 Dec 07 18:50:05.850408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 425/872] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:50:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:06.218861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-d73a3e71-241a-480d-b9b4-092c96dfa8d0 req-126cbe2f-6e95-430f-bb58-9abb362ae542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96bd7c62-a12b-4a95-9b1f-639fac268fb2", "tag": "25d61882-709c-4f2c-acd4-42efcd475bc1"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:06.220351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:50:06.220351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:50:06.228182 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-d73a3e71-241a-480d-b9b4-092c96dfa8d0 req-126cbe2f-6e95-430f-bb58-9abb362ae542 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.228625 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-d73a3e71-241a-480d-b9b4-092c96dfa8d0 req-126cbe2f-6e95-430f-bb58-9abb362ae542 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.239845 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-d73a3e71-241a-480d-b9b4-092c96dfa8d0 req-126cbe2f-6e95-430f-bb58-9abb362ae542 service nova] Creating event network-changed:25d61882-709c-4f2c-acd4-42efcd475bc1 for instance 96bd7c62-a12b-4a95-9b1f-639fac268fb2 on hv-cinder-81969 Dec 07 18:50:06.244338 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-d73a3e71-241a-480d-b9b4-092c96dfa8d0 req-126cbe2f-6e95-430f-bb58-9abb362ae542 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030445 Dec 07 18:50:06.244927 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 448/873] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:06.331919 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:06.332606 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:06.338633 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.339075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.339832 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.340260 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.478001 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:06.486554 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:06.488109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:06.489256 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3e59c0ad-19e8-40ba-b9f1-938213085fd9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1601 microversion: 2.20 time: 0.161339 Dec 07 18:50:06.489814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 426/874] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:50:06 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1601 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:50:06.508073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-487d3db4-0f86-427c-ba08-b639a4846156 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:06.508721 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-487d3db4-0f86-427c-ba08-b639a4846156 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:06.515017 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-487d3db4-0f86-427c-ba08-b639a4846156 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.515541 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-487d3db4-0f86-427c-ba08-b639a4846156 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.516400 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-487d3db4-0f86-427c-ba08-b639a4846156 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.516898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-487d3db4-0f86-427c-ba08-b639a4846156 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.662450 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-487d3db4-0f86-427c-ba08-b639a4846156 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.158763 Dec 07 18:50:06.663064 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 449/875] 10.222.0.41 () {60 vars in 1315 bytes} [Tue Dec 7 18:50:06 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:06.690539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:06.691229 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:06.697377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.697927 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.698943 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.699486 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.767897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:06.768418 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:06.774391 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.775054 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.776114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:06.776734 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:06.992008 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:07.000209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-686997f0-7cb1-43f1-b65a-1fbd88fb994b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1576 microversion: 2.1 time: 0.313415 Dec 07 18:50:07.000787 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 427/876] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:06 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1576 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:07.005369 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-af3f2338-6618-4694-a0ad-8be965948bd3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:07.006545 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-af3f2338-6618-4694-a0ad-8be965948bd3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:07.012750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af3f2338-6618-4694-a0ad-8be965948bd3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:07.013199 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af3f2338-6618-4694-a0ad-8be965948bd3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:07.014542 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af3f2338-6618-4694-a0ad-8be965948bd3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:07.014969 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-af3f2338-6618-4694-a0ad-8be965948bd3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:07.055632 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:07.063997 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-43fff036-ce9d-4cb7-9ac2-d2ed65cd445f tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1318 microversion: 2.1 time: 0.300876 Dec 07 18:50:07.064850 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 450/877] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:06 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:50:07.098436 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-af3f2338-6618-4694-a0ad-8be965948bd3 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.096155 Dec 07 18:50:07.099368 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 428/878] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:07 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:50:07.708930 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2dc30c1c-d368-41bb-8b0c-88196e951dcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:07.709894 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2dc30c1c-d368-41bb-8b0c-88196e951dcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:07.712568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-d8132267-52c7-4fd3-9729-04e83fd9c317 req-11154269-3361-492b-b543-a33b4cdc2cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017abb4f-1da1-4373-83da-f4e5b0d2516b", "tag": "9d321fb6-c496-4034-a6c7-7c7410c908b0"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:07.714077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:50:07.714077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:50:07.716800 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2dc30c1c-d368-41bb-8b0c-88196e951dcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:07.718355 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2dc30c1c-d368-41bb-8b0c-88196e951dcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:07.719241 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2dc30c1c-d368-41bb-8b0c-88196e951dcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:07.719657 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2dc30c1c-d368-41bb-8b0c-88196e951dcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:07.724077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d8132267-52c7-4fd3-9729-04e83fd9c317 req-11154269-3361-492b-b543-a33b4cdc2cb6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:07.724077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d8132267-52c7-4fd3-9729-04e83fd9c317 req-11154269-3361-492b-b543-a33b4cdc2cb6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:07.737707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-d8132267-52c7-4fd3-9729-04e83fd9c317 req-11154269-3361-492b-b543-a33b4cdc2cb6 service nova] Creating event network-changed:9d321fb6-c496-4034-a6c7-7c7410c908b0 for instance 017abb4f-1da1-4373-83da-f4e5b0d2516b on hv-cinder-81969 Dec 07 18:50:07.743669 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-d8132267-52c7-4fd3-9729-04e83fd9c317 req-11154269-3361-492b-b543-a33b4cdc2cb6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035129 Dec 07 18:50:07.744896 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 429/879] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:50:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:50:07.941495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2dc30c1c-d368-41bb-8b0c-88196e951dcb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.235494 Dec 07 18:50:07.945222 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 451/880] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:07 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:08.017698 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:08.018511 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:08.025462 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.026057 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:08.027013 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.027444 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:08.082258 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:08.084007 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:08.094941 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.095566 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:08.098005 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.098653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:08.173964 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:08.181650 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6b93f413-4663-4344-bda4-373e8c185d4c tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1563 microversion: 2.1 time: 0.168776 Dec 07 18:50:08.182257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 430/881] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:08 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:08.187178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bfec00f1-549c-41b1-9f52-beb162546d05 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:08.188924 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bfec00f1-549c-41b1-9f52-beb162546d05 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:08.195904 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfec00f1-549c-41b1-9f52-beb162546d05 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.196691 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfec00f1-549c-41b1-9f52-beb162546d05 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:08.197626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfec00f1-549c-41b1-9f52-beb162546d05 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.198238 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfec00f1-549c-41b1-9f52-beb162546d05 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:08.262405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bfec00f1-549c-41b1-9f52-beb162546d05 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.078706 Dec 07 18:50:08.263046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 431/882] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:08 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:50:08.329222 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:08.336649 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-12d6b568-d9dd-4224-af03-d6711e45487e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1318 microversion: 2.1 time: 0.258946 Dec 07 18:50:08.337201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 452/883] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:08 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:08.953171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-be2dbfec-2745-4182-ab00-f72945f510ee tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:08.954180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-be2dbfec-2745-4182-ab00-f72945f510ee tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:08.960951 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be2dbfec-2745-4182-ab00-f72945f510ee tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.961389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be2dbfec-2745-4182-ab00-f72945f510ee tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:08.962177 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be2dbfec-2745-4182-ab00-f72945f510ee tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:08.962603 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be2dbfec-2745-4182-ab00-f72945f510ee tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:09.031831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-be2dbfec-2745-4182-ab00-f72945f510ee tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.082665 Dec 07 18:50:09.032468 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 432/884] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:08 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:09.273678 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-30badd3e-aeb5-49d6-8e2d-71008df43893 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:09.274613 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-30badd3e-aeb5-49d6-8e2d-71008df43893 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:09.281622 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30badd3e-aeb5-49d6-8e2d-71008df43893 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:09.282095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30badd3e-aeb5-49d6-8e2d-71008df43893 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:09.282867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30badd3e-aeb5-49d6-8e2d-71008df43893 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:09.283303 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30badd3e-aeb5-49d6-8e2d-71008df43893 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:09.346675 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-30badd3e-aeb5-49d6-8e2d-71008df43893 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.076580 Dec 07 18:50:09.347282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 453/885] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:09 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:50:09.353113 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:09.353803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:09.360559 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:09.360998 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:09.361760 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:09.362209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:09.494868 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:09.503204 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ff47b03f-75cc-4020-ac5c-c19c76a85973 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1318 microversion: 2.1 time: 0.154044 Dec 07 18:50:09.503824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 433/886] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:09 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:10.043292 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-efaf91cd-e76d-4dfc-9bb2-d45d7b5c910b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:10.044294 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-efaf91cd-e76d-4dfc-9bb2-d45d7b5c910b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:10.051880 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efaf91cd-e76d-4dfc-9bb2-d45d7b5c910b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:10.052327 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efaf91cd-e76d-4dfc-9bb2-d45d7b5c910b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:10.053100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efaf91cd-e76d-4dfc-9bb2-d45d7b5c910b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:10.053546 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-efaf91cd-e76d-4dfc-9bb2-d45d7b5c910b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:10.117140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-efaf91cd-e76d-4dfc-9bb2-d45d7b5c910b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.077816 Dec 07 18:50:10.117765 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 454/887] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:10 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:10.357313 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7eea44d1-5c64-4045-a2fb-a025cffcbcaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:10.358907 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7eea44d1-5c64-4045-a2fb-a025cffcbcaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:10.365152 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7eea44d1-5c64-4045-a2fb-a025cffcbcaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:10.365599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7eea44d1-5c64-4045-a2fb-a025cffcbcaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:10.366398 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7eea44d1-5c64-4045-a2fb-a025cffcbcaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:10.366830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7eea44d1-5c64-4045-a2fb-a025cffcbcaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:10.428655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7eea44d1-5c64-4045-a2fb-a025cffcbcaf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.074912 Dec 07 18:50:10.429281 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 434/888] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:10 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:50:10.520778 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:10.521471 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:10.528267 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:10.528711 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:10.530333 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:10.530708 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:10.666060 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:10.674056 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8d9bdeed-867c-41d5-b525-fc55f7247c43 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1318 microversion: 2.1 time: 0.156966 Dec 07 18:50:10.674619 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 455/889] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:10 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:11.129083 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b8087ac5-e31f-44d6-9d4e-bd01e2c8f4b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:11.130101 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b8087ac5-e31f-44d6-9d4e-bd01e2c8f4b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:11.136825 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b8087ac5-e31f-44d6-9d4e-bd01e2c8f4b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:11.137270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b8087ac5-e31f-44d6-9d4e-bd01e2c8f4b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:11.138053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b8087ac5-e31f-44d6-9d4e-bd01e2c8f4b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:11.139116 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b8087ac5-e31f-44d6-9d4e-bd01e2c8f4b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:11.212907 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b8087ac5-e31f-44d6-9d4e-bd01e2c8f4b6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.087707 Dec 07 18:50:11.213563 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 435/890] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:11 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:11.439329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-479f079d-e624-492a-8132-1cbbe5b3905a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:11.440267 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-479f079d-e624-492a-8132-1cbbe5b3905a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:11.446460 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-479f079d-e624-492a-8132-1cbbe5b3905a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:11.446905 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-479f079d-e624-492a-8132-1cbbe5b3905a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:11.447668 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-479f079d-e624-492a-8132-1cbbe5b3905a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:11.448095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-479f079d-e624-492a-8132-1cbbe5b3905a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:11.517551 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-479f079d-e624-492a-8132-1cbbe5b3905a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 14 microversion: 2.1 time: 0.081587 Dec 07 18:50:11.518223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 456/891] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:11 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 07 18:50:11.691778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:11.692380 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:11.699161 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:11.699604 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:11.700372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:11.700814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:11.736010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-3180bf9d-2506-4d8d-a72f-7d5eadd86c00 req-71d156b5-821b-4ac4-93cf-bbad137075a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bd7c62-a12b-4a95-9b1f-639fac268fb2", "name": "network-vif-plugged", "status": "completed", "tag": "25d61882-709c-4f2c-acd4-42efcd475bc1"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:11.737751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:50:11.737751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:50:11.747041 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-3180bf9d-2506-4d8d-a72f-7d5eadd86c00 req-71d156b5-821b-4ac4-93cf-bbad137075a8 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:11.747610 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-3180bf9d-2506-4d8d-a72f-7d5eadd86c00 req-71d156b5-821b-4ac4-93cf-bbad137075a8 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:11.766238 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-3180bf9d-2506-4d8d-a72f-7d5eadd86c00 req-71d156b5-821b-4ac4-93cf-bbad137075a8 service nova] Creating event network-vif-plugged:25d61882-709c-4f2c-acd4-42efcd475bc1 for instance 96bd7c62-a12b-4a95-9b1f-639fac268fb2 on hv-cinder-81969 Dec 07 18:50:11.771293 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-3180bf9d-2506-4d8d-a72f-7d5eadd86c00 req-71d156b5-821b-4ac4-93cf-bbad137075a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040207 Dec 07 18:50:11.772774 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 457/892] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:50:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:11.860452 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:11.868920 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-53cb380a-337e-4f53-9080-4ec9197c7f7c tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1318 microversion: 2.1 time: 0.181115 Dec 07 18:50:11.871313 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 436/893] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:11 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:50:12.225066 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8c1d1314-af06-4b66-94d8-0da2b55d383a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:12.225991 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8c1d1314-af06-4b66-94d8-0da2b55d383a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:12.231984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c1d1314-af06-4b66-94d8-0da2b55d383a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:12.232501 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c1d1314-af06-4b66-94d8-0da2b55d383a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:12.233306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c1d1314-af06-4b66-94d8-0da2b55d383a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:12.233734 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8c1d1314-af06-4b66-94d8-0da2b55d383a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:12.296048 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8c1d1314-af06-4b66-94d8-0da2b55d383a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.075513 Dec 07 18:50:12.296646 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 458/894] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:12 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:12.530118 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-55867169-c331-4b33-b4bd-32aa06fd6f70 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:12.531015 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-55867169-c331-4b33-b4bd-32aa06fd6f70 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:12.537230 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55867169-c331-4b33-b4bd-32aa06fd6f70 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:12.537673 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55867169-c331-4b33-b4bd-32aa06fd6f70 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:12.538469 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55867169-c331-4b33-b4bd-32aa06fd6f70 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:12.538902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-55867169-c331-4b33-b4bd-32aa06fd6f70 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:12.620679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-55867169-c331-4b33-b4bd-32aa06fd6f70 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 376 microversion: 2.1 time: 0.094888 Dec 07 18:50:12.621294 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 437/895] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:12 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:12.887878 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:12.888575 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:12.895381 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:12.895832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:12.896602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:12.897033 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:13.026617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:13.034981 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8f4bcc3e-4cdd-4e0f-97a0-2388f2b731c5 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1318 microversion: 2.1 time: 0.151132 Dec 07 18:50:13.035549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 459/896] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:12 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:13.307108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ae02948b-e7fb-4a39-a4a7-d7de0f3d5e1f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:13.308118 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ae02948b-e7fb-4a39-a4a7-d7de0f3d5e1f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:13.316106 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae02948b-e7fb-4a39-a4a7-d7de0f3d5e1f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:13.316554 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae02948b-e7fb-4a39-a4a7-d7de0f3d5e1f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:13.317332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae02948b-e7fb-4a39-a4a7-d7de0f3d5e1f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:13.317762 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae02948b-e7fb-4a39-a4a7-d7de0f3d5e1f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:13.414342 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ae02948b-e7fb-4a39-a4a7-d7de0f3d5e1f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.111284 Dec 07 18:50:13.415015 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 438/897] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:13 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:13.630665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9e0af983-3378-411d-b7ae-cc1cdbebf314 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:13.631474 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9e0af983-3378-411d-b7ae-cc1cdbebf314 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:13.637615 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e0af983-3378-411d-b7ae-cc1cdbebf314 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:13.638095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e0af983-3378-411d-b7ae-cc1cdbebf314 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:13.639428 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e0af983-3378-411d-b7ae-cc1cdbebf314 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:13.639877 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9e0af983-3378-411d-b7ae-cc1cdbebf314 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:13.727220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9e0af983-3378-411d-b7ae-cc1cdbebf314 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 8749 microversion: 2.1 time: 0.100126 Dec 07 18:50:13.727864 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 460/898] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:13 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 8749 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:50:14.052226 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:14.052923 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:14.059745 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.060195 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.061476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.061916 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.197042 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:14.205176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-599b3e5e-40b0-42d7-bb04-95fee78cba13 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1506 microversion: 2.1 time: 0.157192 Dec 07 18:50:14.205928 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 439/899] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:14 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:14.228252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1e313a83-26e8-44d1-88a4-f7abb9c1d084 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "396429e5-a0ac-4c58-a11d-bd1c1b6c4771", "device": "/dev/sdb"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:14.229870 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-1e313a83-26e8-44d1-88a4-f7abb9c1d084 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:14.237200 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1e313a83-26e8-44d1-88a4-f7abb9c1d084 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.237636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1e313a83-26e8-44d1-88a4-f7abb9c1d084 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.238546 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1e313a83-26e8-44d1-88a4-f7abb9c1d084 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.238974 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1e313a83-26e8-44d1-88a4-f7abb9c1d084 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.426442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8f94b4bc-302f-4faa-84b2-04a323de0a73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:14.427468 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8f94b4bc-302f-4faa-84b2-04a323de0a73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:14.434231 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f94b4bc-302f-4faa-84b2-04a323de0a73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.434684 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f94b4bc-302f-4faa-84b2-04a323de0a73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.435499 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f94b4bc-302f-4faa-84b2-04a323de0a73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.435925 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8f94b4bc-302f-4faa-84b2-04a323de0a73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.475404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1e313a83-26e8-44d1-88a4-f7abb9c1d084 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "POST /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251038 Dec 07 18:50:14.476185 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 461/900] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:50:14 2021] POST /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:14.528663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8f94b4bc-302f-4faa-84b2-04a323de0a73 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.101720 Dec 07 18:50:14.528663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 440/901] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:14 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:50:14.739433 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-af9b10f6-a67f-4c1b-bd95-a0690d3b6dc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:14.740417 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-af9b10f6-a67f-4c1b-bd95-a0690d3b6dc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:14.746448 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9b10f6-a67f-4c1b-bd95-a0690d3b6dc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.746897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9b10f6-a67f-4c1b-bd95-a0690d3b6dc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.747663 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9b10f6-a67f-4c1b-bd95-a0690d3b6dc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:14.748876 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9b10f6-a67f-4c1b-bd95-a0690d3b6dc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:14.824897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-af9b10f6-a67f-4c1b-bd95-a0690d3b6dc6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 15025 microversion: 2.1 time: 0.089742 Dec 07 18:50:14.825520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 462/902] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:14 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 15025 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:15.535408 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d0b47ca0-b550-4fa7-bdcb-1c538c68c665 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:15.536404 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d0b47ca0-b550-4fa7-bdcb-1c538c68c665 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:15.543677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d0b47ca0-b550-4fa7-bdcb-1c538c68c665 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:15.544132 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d0b47ca0-b550-4fa7-bdcb-1c538c68c665 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:15.544929 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d0b47ca0-b550-4fa7-bdcb-1c538c68c665 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:15.545383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d0b47ca0-b550-4fa7-bdcb-1c538c68c665 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:15.615149 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d0b47ca0-b550-4fa7-bdcb-1c538c68c665 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.083679 Dec 07 18:50:15.615786 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 441/903] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:15 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:15.837534 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-30ccacfb-ce42-4f80-8c79-b82f8cf1a531 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:15.838546 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-30ccacfb-ce42-4f80-8c79-b82f8cf1a531 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:15.845937 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30ccacfb-ce42-4f80-8c79-b82f8cf1a531 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:15.846388 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30ccacfb-ce42-4f80-8c79-b82f8cf1a531 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:15.847152 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30ccacfb-ce42-4f80-8c79-b82f8cf1a531 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:15.847578 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30ccacfb-ce42-4f80-8c79-b82f8cf1a531 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:15.924445 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-30ccacfb-ce42-4f80-8c79-b82f8cf1a531 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 18025 microversion: 2.1 time: 0.091026 Dec 07 18:50:15.925073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 463/904] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:15 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 18025 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:16.626354 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f4e918ba-61c7-48cf-9e2a-e33fd96f492e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:16.627361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f4e918ba-61c7-48cf-9e2a-e33fd96f492e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:16.634937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4e918ba-61c7-48cf-9e2a-e33fd96f492e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:16.635389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4e918ba-61c7-48cf-9e2a-e33fd96f492e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:16.636171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4e918ba-61c7-48cf-9e2a-e33fd96f492e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:16.636599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f4e918ba-61c7-48cf-9e2a-e33fd96f492e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:16.702940 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f4e918ba-61c7-48cf-9e2a-e33fd96f492e tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.080503 Dec 07 18:50:16.703607 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 442/905] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:16 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:16.936522 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-03dee756-7318-4a81-b2e8-60d4dd2cb748 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:16.937508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-03dee756-7318-4a81-b2e8-60d4dd2cb748 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:16.944447 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-03dee756-7318-4a81-b2e8-60d4dd2cb748 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:16.944887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-03dee756-7318-4a81-b2e8-60d4dd2cb748 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:16.945673 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-03dee756-7318-4a81-b2e8-60d4dd2cb748 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:16.946137 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-03dee756-7318-4a81-b2e8-60d4dd2cb748 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:17.036837 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-03dee756-7318-4a81-b2e8-60d4dd2cb748 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 18424 microversion: 2.1 time: 0.104368 Dec 07 18:50:17.037374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 464/906] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:16 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 18424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:17.714139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6db4127c-6389-4704-986d-dd12b19c5ad4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:17.715167 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6db4127c-6389-4704-986d-dd12b19c5ad4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:17.722491 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6db4127c-6389-4704-986d-dd12b19c5ad4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:17.722936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6db4127c-6389-4704-986d-dd12b19c5ad4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:17.723706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6db4127c-6389-4704-986d-dd12b19c5ad4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:17.724174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6db4127c-6389-4704-986d-dd12b19c5ad4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:17.785779 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6db4127c-6389-4704-986d-dd12b19c5ad4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.075524 Dec 07 18:50:17.786466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 443/907] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:17 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:18.048847 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2a3a8b98-6e42-4517-bbbd-18f345bcb8d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:18.049754 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2a3a8b98-6e42-4517-bbbd-18f345bcb8d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:18.056606 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a3a8b98-6e42-4517-bbbd-18f345bcb8d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:18.057058 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a3a8b98-6e42-4517-bbbd-18f345bcb8d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:18.057827 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a3a8b98-6e42-4517-bbbd-18f345bcb8d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:18.058301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2a3a8b98-6e42-4517-bbbd-18f345bcb8d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:18.134463 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2a3a8b98-6e42-4517-bbbd-18f345bcb8d2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 20148 microversion: 2.1 time: 0.089802 Dec 07 18:50:18.135092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 465/908] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:18 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 20148 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:18.797493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-064b29ff-44dd-4e3e-9e23-fba5dd3a2c06 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:18.798780 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-064b29ff-44dd-4e3e-9e23-fba5dd3a2c06 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:18.805563 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-064b29ff-44dd-4e3e-9e23-fba5dd3a2c06 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:18.806040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-064b29ff-44dd-4e3e-9e23-fba5dd3a2c06 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:18.806810 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-064b29ff-44dd-4e3e-9e23-fba5dd3a2c06 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:18.807270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-064b29ff-44dd-4e3e-9e23-fba5dd3a2c06 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:18.873694 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-064b29ff-44dd-4e3e-9e23-fba5dd3a2c06 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.080534 Dec 07 18:50:18.874377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 444/909] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:18 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:19.145823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0c79a12a-2c4e-4c11-861b-0a3c30b88a4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:19.146757 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0c79a12a-2c4e-4c11-861b-0a3c30b88a4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:19.153451 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c79a12a-2c4e-4c11-861b-0a3c30b88a4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:19.154691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c79a12a-2c4e-4c11-861b-0a3c30b88a4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:19.155532 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c79a12a-2c4e-4c11-861b-0a3c30b88a4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:19.155957 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0c79a12a-2c4e-4c11-861b-0a3c30b88a4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:19.256245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0c79a12a-2c4e-4c11-861b-0a3c30b88a4a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 22494 microversion: 2.1 time: 0.114331 Dec 07 18:50:19.256875 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 466/910] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:19 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 22494 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:19.885219 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d381eb00-6338-4716-9594-ec787f5983b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:19.886230 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d381eb00-6338-4716-9594-ec787f5983b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:19.893592 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d381eb00-6338-4716-9594-ec787f5983b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:19.894066 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d381eb00-6338-4716-9594-ec787f5983b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:19.894826 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d381eb00-6338-4716-9594-ec787f5983b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:19.895250 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d381eb00-6338-4716-9594-ec787f5983b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:19.958201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d381eb00-6338-4716-9594-ec787f5983b2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.076884 Dec 07 18:50:19.959003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 445/911] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:19 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:20.268271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-7f8ecdbb-99b3-41a8-b1dd-d543f39e3156 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:20.269358 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-7f8ecdbb-99b3-41a8-b1dd-d543f39e3156 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:20.276067 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7f8ecdbb-99b3-41a8-b1dd-d543f39e3156 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:20.276511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7f8ecdbb-99b3-41a8-b1dd-d543f39e3156 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:20.277266 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7f8ecdbb-99b3-41a8-b1dd-d543f39e3156 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:20.277700 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-7f8ecdbb-99b3-41a8-b1dd-d543f39e3156 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:20.351860 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-7f8ecdbb-99b3-41a8-b1dd-d543f39e3156 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 23601 microversion: 2.1 time: 0.087546 Dec 07 18:50:20.352494 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 467/912] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:20 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 23601 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:20.971442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-37bb3592-022a-4319-8a58-14f8f9f512b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:20.972427 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-37bb3592-022a-4319-8a58-14f8f9f512b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:20.979240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37bb3592-022a-4319-8a58-14f8f9f512b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:20.979692 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37bb3592-022a-4319-8a58-14f8f9f512b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:20.980463 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37bb3592-022a-4319-8a58-14f8f9f512b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:20.980897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-37bb3592-022a-4319-8a58-14f8f9f512b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:21.043860 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-37bb3592-022a-4319-8a58-14f8f9f512b7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 14 microversion: 2.20 time: 0.077286 Dec 07 18:50:21.044647 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 446/913] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:20 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:21.363414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f3acf9ba-16d2-4ac2-a0ed-326e62beca6d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:21.364411 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f3acf9ba-16d2-4ac2-a0ed-326e62beca6d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:21.371234 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3acf9ba-16d2-4ac2-a0ed-326e62beca6d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:21.371680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3acf9ba-16d2-4ac2-a0ed-326e62beca6d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:21.372446 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3acf9ba-16d2-4ac2-a0ed-326e62beca6d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:21.373694 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3acf9ba-16d2-4ac2-a0ed-326e62beca6d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:21.450934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f3acf9ba-16d2-4ac2-a0ed-326e62beca6d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 24580 microversion: 2.1 time: 0.091319 Dec 07 18:50:21.451825 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 468/914] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:21 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 24580 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:22.055365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6f5eca8b-89e0-4102-baeb-a179a104efed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:22.056349 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6f5eca8b-89e0-4102-baeb-a179a104efed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:22.063071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6f5eca8b-89e0-4102-baeb-a179a104efed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:22.063512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6f5eca8b-89e0-4102-baeb-a179a104efed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:22.064273 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6f5eca8b-89e0-4102-baeb-a179a104efed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:22.064701 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6f5eca8b-89e0-4102-baeb-a179a104efed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:22.145123 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6f5eca8b-89e0-4102-baeb-a179a104efed tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 10095 microversion: 2.20 time: 0.093642 Dec 07 18:50:22.145778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 447/915] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:22 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 10095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:22.463391 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0482c7d3-da7a-43f0-9a1f-d0e983d3a5ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:22.464377 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0482c7d3-da7a-43f0-9a1f-d0e983d3a5ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:22.472126 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0482c7d3-da7a-43f0-9a1f-d0e983d3a5ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:22.472572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0482c7d3-da7a-43f0-9a1f-d0e983d3a5ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:22.473347 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0482c7d3-da7a-43f0-9a1f-d0e983d3a5ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:22.473782 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0482c7d3-da7a-43f0-9a1f-d0e983d3a5ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:23.156866 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cc5cb213-1c9f-4dca-b207-5ad954c75af0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:23.157968 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cc5cb213-1c9f-4dca-b207-5ad954c75af0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:23.165662 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc5cb213-1c9f-4dca-b207-5ad954c75af0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:23.166078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc5cb213-1c9f-4dca-b207-5ad954c75af0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:23.166855 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc5cb213-1c9f-4dca-b207-5ad954c75af0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:23.167284 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cc5cb213-1c9f-4dca-b207-5ad954c75af0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:25.250639 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0482c7d3-da7a-43f0-9a1f-d0e983d3a5ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 27451 microversion: 2.1 time: 2.791017 Dec 07 18:50:25.251286 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 469/916] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:22 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 27451 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:25.275628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cc5cb213-1c9f-4dca-b207-5ad954c75af0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 18356 microversion: 2.20 time: 2.122639 Dec 07 18:50:25.276997 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 448/917] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:23 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 18356 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:26.262443 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-28c1ca32-283c-4f7e-a958-6cdf91da8dc4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:26.263944 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-28c1ca32-283c-4f7e-a958-6cdf91da8dc4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:26.273485 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28c1ca32-283c-4f7e-a958-6cdf91da8dc4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:26.273946 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28c1ca32-283c-4f7e-a958-6cdf91da8dc4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:26.274727 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28c1ca32-283c-4f7e-a958-6cdf91da8dc4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:26.275164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28c1ca32-283c-4f7e-a958-6cdf91da8dc4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:26.288853 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2cec9b8a-cc2c-49e7-b375-c54effdf12c3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:26.289885 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2cec9b8a-cc2c-49e7-b375-c54effdf12c3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:26.297455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cec9b8a-cc2c-49e7-b375-c54effdf12c3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:26.297897 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cec9b8a-cc2c-49e7-b375-c54effdf12c3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:26.298951 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cec9b8a-cc2c-49e7-b375-c54effdf12c3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:26.299376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2cec9b8a-cc2c-49e7-b375-c54effdf12c3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:26.365723 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-28c1ca32-283c-4f7e-a958-6cdf91da8dc4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 27742 microversion: 2.1 time: 0.107118 Dec 07 18:50:26.366330 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 470/918] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:26 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 27742 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:26.409517 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2cec9b8a-cc2c-49e7-b375-c54effdf12c3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 19944 microversion: 2.20 time: 0.124553 Dec 07 18:50:26.410170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 449/919] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:26 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 19944 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:27.378037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-af9f3db6-4828-46ad-b3ea-aa4d035b1c08 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:27.379024 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-af9f3db6-4828-46ad-b3ea-aa4d035b1c08 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:27.385728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9f3db6-4828-46ad-b3ea-aa4d035b1c08 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:27.386199 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9f3db6-4828-46ad-b3ea-aa4d035b1c08 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:27.386970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9f3db6-4828-46ad-b3ea-aa4d035b1c08 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:27.387401 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af9f3db6-4828-46ad-b3ea-aa4d035b1c08 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:27.422640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-31712463-e874-4bd8-a0b4-0d9560037b3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:27.423886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-31712463-e874-4bd8-a0b4-0d9560037b3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:27.430752 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-31712463-e874-4bd8-a0b4-0d9560037b3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:27.431198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-31712463-e874-4bd8-a0b4-0d9560037b3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:27.432111 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-31712463-e874-4bd8-a0b4-0d9560037b3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:27.432389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-31712463-e874-4bd8-a0b4-0d9560037b3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:29.406653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-af9f3db6-4828-46ad-b3ea-aa4d035b1c08 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 27989 microversion: 2.1 time: 2.032395 Dec 07 18:50:29.407335 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 471/920] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:27 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 27989 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:29.422884 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-31712463-e874-4bd8-a0b4-0d9560037b3b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 23798 microversion: 2.20 time: 2.005262 Dec 07 18:50:29.423804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 450/921] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:27 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 23798 bytes in 2007 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:30.418526 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-681bd51a-ae55-45f4-9903-f0a1423c7abb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:30.420149 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-681bd51a-ae55-45f4-9903-f0a1423c7abb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:30.428102 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-681bd51a-ae55-45f4-9903-f0a1423c7abb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:30.428549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-681bd51a-ae55-45f4-9903-f0a1423c7abb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:30.429313 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-681bd51a-ae55-45f4-9903-f0a1423c7abb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:30.430093 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-681bd51a-ae55-45f4-9903-f0a1423c7abb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:30.435287 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f42c98a2-4b22-4531-85d8-19c23df53aca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:30.436291 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f42c98a2-4b22-4531-85d8-19c23df53aca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:30.443667 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f42c98a2-4b22-4531-85d8-19c23df53aca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:30.444110 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f42c98a2-4b22-4531-85d8-19c23df53aca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:30.444891 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f42c98a2-4b22-4531-85d8-19c23df53aca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:30.445327 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f42c98a2-4b22-4531-85d8-19c23df53aca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:30.516752 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-681bd51a-ae55-45f4-9903-f0a1423c7abb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28172 microversion: 2.1 time: 0.102017 Dec 07 18:50:30.517470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 472/922] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:30 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28172 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:30.532977 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f42c98a2-4b22-4531-85d8-19c23df53aca tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 24846 microversion: 2.20 time: 0.101694 Dec 07 18:50:30.533622 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 451/923] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:30 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 24846 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:31.529712 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-312a77c0-2477-4308-b761-1f4fc8de4800 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:31.530750 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-312a77c0-2477-4308-b761-1f4fc8de4800 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:31.537552 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-312a77c0-2477-4308-b761-1f4fc8de4800 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:31.538052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-312a77c0-2477-4308-b761-1f4fc8de4800 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:31.538828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-312a77c0-2477-4308-b761-1f4fc8de4800 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:31.539349 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-312a77c0-2477-4308-b761-1f4fc8de4800 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:31.545840 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bd12b90d-de4b-4888-a32f-fad6385ac76c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:31.546847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bd12b90d-de4b-4888-a32f-fad6385ac76c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:31.553808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd12b90d-de4b-4888-a32f-fad6385ac76c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:31.554299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd12b90d-de4b-4888-a32f-fad6385ac76c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:31.555076 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd12b90d-de4b-4888-a32f-fad6385ac76c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:31.555506 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bd12b90d-de4b-4888-a32f-fad6385ac76c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:31.618316 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-312a77c0-2477-4308-b761-1f4fc8de4800 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28172 microversion: 2.1 time: 0.093300 Dec 07 18:50:31.619207 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 473/924] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:31 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28172 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:31.638911 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bd12b90d-de4b-4888-a32f-fad6385ac76c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 25888 microversion: 2.20 time: 0.097362 Dec 07 18:50:31.639749 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 452/925] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:31 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 25888 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:32.629834 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-37fc1bda-34aa-4c8f-9266-c1e6ff5eb044 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:32.630838 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-37fc1bda-34aa-4c8f-9266-c1e6ff5eb044 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:32.637561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-37fc1bda-34aa-4c8f-9266-c1e6ff5eb044 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:32.638115 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-37fc1bda-34aa-4c8f-9266-c1e6ff5eb044 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:32.638904 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-37fc1bda-34aa-4c8f-9266-c1e6ff5eb044 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:32.639331 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-37fc1bda-34aa-4c8f-9266-c1e6ff5eb044 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:32.650902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-fc676fd1-f12a-431d-88b1-61417678efcc tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:32.651937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-fc676fd1-f12a-431d-88b1-61417678efcc tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:32.659420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fc676fd1-f12a-431d-88b1-61417678efcc tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:32.659873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fc676fd1-f12a-431d-88b1-61417678efcc tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:32.660683 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fc676fd1-f12a-431d-88b1-61417678efcc tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:32.661115 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-fc676fd1-f12a-431d-88b1-61417678efcc tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:32.735442 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-37fc1bda-34aa-4c8f-9266-c1e6ff5eb044 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28314 microversion: 2.1 time: 0.108829 Dec 07 18:50:32.736123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 474/926] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:32 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28314 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:32.769440 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-fc676fd1-f12a-431d-88b1-61417678efcc tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 26688 microversion: 2.20 time: 0.122391 Dec 07 18:50:32.770148 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 453/927] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:32 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 26688 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:33.601621 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:33.602217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:33.609034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:33.609584 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:33.610378 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:33.610808 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:33.689081 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lazy-loading 'services' on Instance uuid 96bd7c62-a12b-4a95-9b1f-639fac268fb2 {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:50:33.748488 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0a944055-6e6b-4578-bf8a-b309a036cb47 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:33.749495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0a944055-6e6b-4578-bf8a-b309a036cb47 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:33.756539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a944055-6e6b-4578-bf8a-b309a036cb47 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:33.756994 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a944055-6e6b-4578-bf8a-b309a036cb47 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:33.757771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a944055-6e6b-4578-bf8a-b309a036cb47 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:33.758339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0a944055-6e6b-4578-bf8a-b309a036cb47 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:33.760026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a1c5d79f-59bc-488e-9760-e7ab7fad2466 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "DELETE /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2/os-volume_attachments/396429e5-a0ac-4c58-a11d-bd1c1b6c4771" status: 202 len: 0 microversion: 2.1 time: 0.162264 Dec 07 18:50:33.760878 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 475/928] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:50:33 2021] DELETE /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2/os-volume_attachments/396429e5-a0ac-4c58-a11d-bd1c1b6c4771 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:33.781658 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2ac06027-21eb-4b78-8d50-e80b8f88cc49 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:33.783031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2ac06027-21eb-4b78-8d50-e80b8f88cc49 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:33.790942 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ac06027-21eb-4b78-8d50-e80b8f88cc49 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:33.791923 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ac06027-21eb-4b78-8d50-e80b8f88cc49 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:33.792762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ac06027-21eb-4b78-8d50-e80b8f88cc49 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:33.793361 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ac06027-21eb-4b78-8d50-e80b8f88cc49 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:33.877224 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0a944055-6e6b-4578-bf8a-b309a036cb47 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28461 microversion: 2.1 time: 0.133316 Dec 07 18:50:33.877952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 454/929] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:33 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28461 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:33.900979 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2ac06027-21eb-4b78-8d50-e80b8f88cc49 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 27390 microversion: 2.20 time: 0.123551 Dec 07 18:50:33.901785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 476/930] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:33 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 27390 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:34.870722 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:34.871314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:34.878335 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:34.878815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:34.879588 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:34.880023 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:34.889572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-28e93e80-b52e-424a-89d0-1059594560ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:34.890933 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-28e93e80-b52e-424a-89d0-1059594560ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:34.897795 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28e93e80-b52e-424a-89d0-1059594560ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:34.898275 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28e93e80-b52e-424a-89d0-1059594560ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:34.899049 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28e93e80-b52e-424a-89d0-1059594560ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:34.899488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-28e93e80-b52e-424a-89d0-1059594560ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:34.907105 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:50:34.979686 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2b52c09e-dc46-4fd6-ad62-f41179c4a2d6 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "DELETE /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 204 len: 0 microversion: 2.1 time: 0.112534 Dec 07 18:50:34.980264 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 455/931] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:50:34 2021] DELETE /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:50:34.985732 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6a47f45c-da01-4757-851f-5d80c736844f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:34.986729 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6a47f45c-da01-4757-851f-5d80c736844f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:34.987194 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-28e93e80-b52e-424a-89d0-1059594560ac tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28628 microversion: 2.1 time: 0.101925 Dec 07 18:50:34.988081 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 477/932] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:34 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28628 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:34.992690 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6a47f45c-da01-4757-851f-5d80c736844f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:34.993201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6a47f45c-da01-4757-851f-5d80c736844f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:34.994064 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6a47f45c-da01-4757-851f-5d80c736844f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:34.994548 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6a47f45c-da01-4757-851f-5d80c736844f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:34.994664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:34.995374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:35.002801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:35.003502 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:35.004429 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:35.004892 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:35.088944 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6a47f45c-da01-4757-851f-5d80c736844f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 27748 microversion: 2.20 time: 0.107191 Dec 07 18:50:35.092798 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 456/933] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:34 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 27748 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:35.142819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:35.150018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-69ae2274-2ab2-4710-9e3a-1163f3dd0764 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1512 microversion: 2.1 time: 0.160798 Dec 07 18:50:35.150582 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 478/934] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:34 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:35.999505 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-96f025b3-a594-43f5-8b21-3b47d7dc9f1d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:36.000493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-96f025b3-a594-43f5-8b21-3b47d7dc9f1d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:36.007589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96f025b3-a594-43f5-8b21-3b47d7dc9f1d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:36.008031 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96f025b3-a594-43f5-8b21-3b47d7dc9f1d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:36.008801 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96f025b3-a594-43f5-8b21-3b47d7dc9f1d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:36.009228 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96f025b3-a594-43f5-8b21-3b47d7dc9f1d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:36.097784 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-96f025b3-a594-43f5-8b21-3b47d7dc9f1d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28628 microversion: 2.1 time: 0.102504 Dec 07 18:50:36.098666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 457/935] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:35 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28628 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:36.100653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8f4490ff-da19-47fc-acd0-5339283f5d8c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:36.101551 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8f4490ff-da19-47fc-acd0-5339283f5d8c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:36.108493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4490ff-da19-47fc-acd0-5339283f5d8c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:36.108938 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4490ff-da19-47fc-acd0-5339283f5d8c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:36.109712 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4490ff-da19-47fc-acd0-5339283f5d8c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:36.110172 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8f4490ff-da19-47fc-acd0-5339283f5d8c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:36.167377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:36.168072 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:36.174936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:36.175384 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:36.176153 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:36.176591 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:36.186955 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8f4490ff-da19-47fc-acd0-5339283f5d8c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 27935 microversion: 2.20 time: 0.089918 Dec 07 18:50:36.188237 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 479/936] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:36 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 27935 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:36.305491 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:36.313687 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-17f878ac-ff59-41f8-aa1a-3a698294f192 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1512 microversion: 2.1 time: 0.150269 Dec 07 18:50:36.314299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 458/937] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:36 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:50:37.110481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fc634740-106a-4955-a9ed-dc122913ad0a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:37.111480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fc634740-106a-4955-a9ed-dc122913ad0a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:37.118433 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc634740-106a-4955-a9ed-dc122913ad0a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:37.118881 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc634740-106a-4955-a9ed-dc122913ad0a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:37.119663 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc634740-106a-4955-a9ed-dc122913ad0a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:37.120095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fc634740-106a-4955-a9ed-dc122913ad0a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:37.192063 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fc634740-106a-4955-a9ed-dc122913ad0a tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28628 microversion: 2.1 time: 0.086133 Dec 07 18:50:37.193816 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 480/938] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:37 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28628 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:37.201250 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ec6d8c29-7ab6-4b16-af14-ab813807b1fa tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:37.202196 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ec6d8c29-7ab6-4b16-af14-ab813807b1fa tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:37.208403 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec6d8c29-7ab6-4b16-af14-ab813807b1fa tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:37.208853 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec6d8c29-7ab6-4b16-af14-ab813807b1fa tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:37.209640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec6d8c29-7ab6-4b16-af14-ab813807b1fa tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:37.210108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ec6d8c29-7ab6-4b16-af14-ab813807b1fa tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:37.288870 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ec6d8c29-7ab6-4b16-af14-ab813807b1fa tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28228 microversion: 2.20 time: 0.091221 Dec 07 18:50:37.290385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 459/939] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:37 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:37.331047 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:37.331859 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:37.338693 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:37.339252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:37.340091 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:37.340593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:37.572237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-77890a8f-2143-4545-a9fe-55faafdc24e9 req-eae8adbe-93eb-4336-a090-c949d9f3c5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bd7c62-a12b-4a95-9b1f-639fac268fb2", "name": "network-vif-deleted", "tag": "25d61882-709c-4f2c-acd4-42efcd475bc1"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:37.573748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:50:37.573748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:50:37.582462 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-77890a8f-2143-4545-a9fe-55faafdc24e9 req-eae8adbe-93eb-4336-a090-c949d9f3c5f1 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:37.583146 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-77890a8f-2143-4545-a9fe-55faafdc24e9 req-eae8adbe-93eb-4336-a090-c949d9f3c5f1 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:37.590896 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3533bdc77e13492cb30ede2634402c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '103d606fa1a54ad8993058e83b59a30c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:50:37.595305 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-77890a8f-2143-4545-a9fe-55faafdc24e9 req-eae8adbe-93eb-4336-a090-c949d9f3c5f1 service nova] Creating event network-vif-deleted:25d61882-709c-4f2c-acd4-42efcd475bc1 for instance 96bd7c62-a12b-4a95-9b1f-639fac268fb2 on hv-cinder-81969 Dec 07 18:50:37.600140 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-77890a8f-2143-4545-a9fe-55faafdc24e9 req-eae8adbe-93eb-4336-a090-c949d9f3c5f1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032279 Dec 07 18:50:37.600748 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 460/940] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:50:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:50:37.601847 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4c877b51-ae1c-49e6-9385-3798773d975e tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 200 len: 1512 microversion: 2.1 time: 0.274734 Dec 07 18:50:37.610869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 481/941] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:37 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:50:38.205686 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b178fa3d-75f4-4f86-977a-93238731d8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:38.206711 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b178fa3d-75f4-4f86-977a-93238731d8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:38.212749 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b178fa3d-75f4-4f86-977a-93238731d8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:38.213198 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b178fa3d-75f4-4f86-977a-93238731d8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:38.214120 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b178fa3d-75f4-4f86-977a-93238731d8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:38.214571 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b178fa3d-75f4-4f86-977a-93238731d8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:38.285577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b178fa3d-75f4-4f86-977a-93238731d8a2 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28628 microversion: 2.1 time: 0.084919 Dec 07 18:50:38.286164 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 461/942] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:38 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28628 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:38.300733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e3daaf4b-4e8a-4b42-8d4a-c76e13b7a482 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:38.301637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e3daaf4b-4e8a-4b42-8d4a-c76e13b7a482 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:38.310319 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e3daaf4b-4e8a-4b42-8d4a-c76e13b7a482 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:38.310764 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e3daaf4b-4e8a-4b42-8d4a-c76e13b7a482 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:38.311527 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e3daaf4b-4e8a-4b42-8d4a-c76e13b7a482 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:38.311960 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e3daaf4b-4e8a-4b42-8d4a-c76e13b7a482 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:38.386198 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e3daaf4b-4e8a-4b42-8d4a-c76e13b7a482 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28228 microversion: 2.20 time: 0.089231 Dec 07 18:50:38.386838 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 482/943] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:38 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28228 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:38.619793 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:38.620409 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] [instance: 96bd7c62-a12b-4a95-9b1f-639fac268fb2] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:38.627647 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:38.628087 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:38.628848 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:38.629283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:38.643052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] HTTP exception thrown: Instance 96bd7c62-a12b-4a95-9b1f-639fac268fb2 could not be found. Dec 07 18:50:38.643616 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] Returning 404 to user: Instance 96bd7c62-a12b-4a95-9b1f-639fac268fb2 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:50:38.644409 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d4d64976-c8b5-46a4-bc55-9771f6af4fe1 tempest-VolumesSnapshotTestJSON-764546366 tempest-VolumesSnapshotTestJSON-764546366-project] 10.222.0.41 "GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2" status: 404 len: 111 microversion: 2.1 time: 0.028738 Dec 07 18:50:38.644917 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 462/944] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:50:38 2021] GET /compute/v2.1/servers/96bd7c62-a12b-4a95-9b1f-639fac268fb2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:50:39.297275 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fe93e930-2531-4c22-a46b-a901e6b0156e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:39.298567 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fe93e930-2531-4c22-a46b-a901e6b0156e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:39.305976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe93e930-2531-4c22-a46b-a901e6b0156e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:39.306590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe93e930-2531-4c22-a46b-a901e6b0156e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:39.307183 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe93e930-2531-4c22-a46b-a901e6b0156e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:39.307609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe93e930-2531-4c22-a46b-a901e6b0156e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:39.399132 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-543ed576-9111-40a6-b1ed-d5ee442a1863 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:39.400040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-543ed576-9111-40a6-b1ed-d5ee442a1863 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:39.407503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-543ed576-9111-40a6-b1ed-d5ee442a1863 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:39.407954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-543ed576-9111-40a6-b1ed-d5ee442a1863 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:39.408737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-543ed576-9111-40a6-b1ed-d5ee442a1863 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:39.409174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-543ed576-9111-40a6-b1ed-d5ee442a1863 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:39.410381 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fe93e930-2531-4c22-a46b-a901e6b0156e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 28653 microversion: 2.1 time: 0.117058 Dec 07 18:50:39.411320 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 483/945] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:39 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 28653 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:39.499876 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-543ed576-9111-40a6-b1ed-d5ee442a1863 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28517 microversion: 2.20 time: 0.104168 Dec 07 18:50:39.501162 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 463/946] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:39 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28517 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:40.424103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-25953539-1644-41d8-9397-8650957d7b0f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:40.425030 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-25953539-1644-41d8-9397-8650957d7b0f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:40.431931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25953539-1644-41d8-9397-8650957d7b0f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:40.432373 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25953539-1644-41d8-9397-8650957d7b0f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:40.433133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25953539-1644-41d8-9397-8650957d7b0f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:40.433562 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-25953539-1644-41d8-9397-8650957d7b0f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:40.512239 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-787d7331-207f-4d2d-b5dd-79c9a5957e72 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:40.513326 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-787d7331-207f-4d2d-b5dd-79c9a5957e72 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:40.520046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-787d7331-207f-4d2d-b5dd-79c9a5957e72 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:40.520489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-787d7331-207f-4d2d-b5dd-79c9a5957e72 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:40.521249 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-787d7331-207f-4d2d-b5dd-79c9a5957e72 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:40.521677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-787d7331-207f-4d2d-b5dd-79c9a5957e72 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:42.999599 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-25953539-1644-41d8-9397-8650957d7b0f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 33282 microversion: 2.1 time: 2.580198 Dec 07 18:50:43.000257 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 484/947] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:40 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 33282 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:43.018161 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-787d7331-207f-4d2d-b5dd-79c9a5957e72 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28519 microversion: 2.20 time: 2.509686 Dec 07 18:50:43.018809 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 464/948] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:40 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28519 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:44.010853 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-30da3b30-6aaf-40a8-b4d6-6e1885014af9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:44.011839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-30da3b30-6aaf-40a8-b4d6-6e1885014af9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:44.019806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30da3b30-6aaf-40a8-b4d6-6e1885014af9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:44.020249 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30da3b30-6aaf-40a8-b4d6-6e1885014af9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:44.021004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30da3b30-6aaf-40a8-b4d6-6e1885014af9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:44.021432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-30da3b30-6aaf-40a8-b4d6-6e1885014af9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:44.029886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9c9a01c5-46f6-4d03-a7e9-1bbf01a21c24 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:44.030936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9c9a01c5-46f6-4d03-a7e9-1bbf01a21c24 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:44.038334 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c9a01c5-46f6-4d03-a7e9-1bbf01a21c24 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:44.038783 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c9a01c5-46f6-4d03-a7e9-1bbf01a21c24 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:44.039564 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c9a01c5-46f6-4d03-a7e9-1bbf01a21c24 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:44.039996 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9c9a01c5-46f6-4d03-a7e9-1bbf01a21c24 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:44.093501 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-30da3b30-6aaf-40a8-b4d6-6e1885014af9 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 34290 microversion: 2.1 time: 0.086523 Dec 07 18:50:44.094308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 485/949] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:44 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 34290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:44.125596 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9c9a01c5-46f6-4d03-a7e9-1bbf01a21c24 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28687 microversion: 2.20 time: 0.100294 Dec 07 18:50:44.129546 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 465/950] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:44 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28687 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:45.104967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4ac5a610-042c-46e1-92be-6b6e78de52af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:45.105885 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4ac5a610-042c-46e1-92be-6b6e78de52af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:45.112694 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ac5a610-042c-46e1-92be-6b6e78de52af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:45.113133 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ac5a610-042c-46e1-92be-6b6e78de52af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:45.113970 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ac5a610-042c-46e1-92be-6b6e78de52af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:45.114399 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4ac5a610-042c-46e1-92be-6b6e78de52af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:45.137279 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7297ee92-91b7-4344-b9db-6548a7733468 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:45.138990 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7297ee92-91b7-4344-b9db-6548a7733468 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:45.146375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7297ee92-91b7-4344-b9db-6548a7733468 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:45.146821 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7297ee92-91b7-4344-b9db-6548a7733468 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:45.147605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7297ee92-91b7-4344-b9db-6548a7733468 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:45.148037 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7297ee92-91b7-4344-b9db-6548a7733468 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:45.188252 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4ac5a610-042c-46e1-92be-6b6e78de52af tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 34906 microversion: 2.1 time: 0.087104 Dec 07 18:50:45.188823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 486/951] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:45 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 34906 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:45.221967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7297ee92-91b7-4344-b9db-6548a7733468 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28687 microversion: 2.20 time: 0.088661 Dec 07 18:50:45.222597 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 466/952] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:45 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28687 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:46.200522 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c16bdc70-1ee7-4ed7-b5b5-3c6e1f5c00fc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:46.201677 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c16bdc70-1ee7-4ed7-b5b5-3c6e1f5c00fc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:46.208681 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c16bdc70-1ee7-4ed7-b5b5-3c6e1f5c00fc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:46.209129 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c16bdc70-1ee7-4ed7-b5b5-3c6e1f5c00fc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:46.209932 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c16bdc70-1ee7-4ed7-b5b5-3c6e1f5c00fc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:46.210369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c16bdc70-1ee7-4ed7-b5b5-3c6e1f5c00fc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:46.234240 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bf594814-ed50-4312-b2e3-01860fa158ea tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:46.235394 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bf594814-ed50-4312-b2e3-01860fa158ea tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:46.242375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bf594814-ed50-4312-b2e3-01860fa158ea tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:46.242823 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bf594814-ed50-4312-b2e3-01860fa158ea tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:46.243599 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bf594814-ed50-4312-b2e3-01860fa158ea tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:46.244028 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bf594814-ed50-4312-b2e3-01860fa158ea tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:46.282789 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c16bdc70-1ee7-4ed7-b5b5-3c6e1f5c00fc tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 36008 microversion: 2.1 time: 0.086255 Dec 07 18:50:46.283689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 487/953] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:46 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 36008 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:46.314877 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bf594814-ed50-4312-b2e3-01860fa158ea tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28687 microversion: 2.20 time: 0.085633 Dec 07 18:50:46.315506 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 467/954] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:46 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28687 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:47.296362 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fbcd9760-348d-4ca4-b5a5-3accbb5cf3e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:47.297347 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fbcd9760-348d-4ca4-b5a5-3accbb5cf3e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:47.304372 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fbcd9760-348d-4ca4-b5a5-3accbb5cf3e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:47.304812 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fbcd9760-348d-4ca4-b5a5-3accbb5cf3e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:47.305572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fbcd9760-348d-4ca4-b5a5-3accbb5cf3e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:47.306032 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fbcd9760-348d-4ca4-b5a5-3accbb5cf3e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:47.326818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-53da407d-e985-4874-b725-3abdf2c84ea3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:47.327824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-53da407d-e985-4874-b725-3abdf2c84ea3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:47.334688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53da407d-e985-4874-b725-3abdf2c84ea3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:47.335141 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53da407d-e985-4874-b725-3abdf2c84ea3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:47.335974 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53da407d-e985-4874-b725-3abdf2c84ea3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:47.336411 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53da407d-e985-4874-b725-3abdf2c84ea3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:47.384547 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fbcd9760-348d-4ca4-b5a5-3accbb5cf3e5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 36967 microversion: 2.1 time: 0.092977 Dec 07 18:50:47.385225 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 488/955] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:47 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 36967 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:47.421008 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-53da407d-e985-4874-b725-3abdf2c84ea3 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28687 microversion: 2.20 time: 0.097097 Dec 07 18:50:47.421667 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 468/956] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:47 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28687 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:48.397004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cc486d87-f08d-4762-abed-3fbd091b6202 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:48.398023 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cc486d87-f08d-4762-abed-3fbd091b6202 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:48.405049 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc486d87-f08d-4762-abed-3fbd091b6202 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:48.405488 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc486d87-f08d-4762-abed-3fbd091b6202 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:48.406272 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc486d87-f08d-4762-abed-3fbd091b6202 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:48.406699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cc486d87-f08d-4762-abed-3fbd091b6202 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:48.432940 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-acd01669-9076-4238-bc66-518ee8060ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:48.433978 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-acd01669-9076-4238-bc66-518ee8060ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:48.442060 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd01669-9076-4238-bc66-518ee8060ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:48.442499 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd01669-9076-4238-bc66-518ee8060ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:48.443471 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd01669-9076-4238-bc66-518ee8060ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:48.443900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-acd01669-9076-4238-bc66-518ee8060ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:50.865656 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cc486d87-f08d-4762-abed-3fbd091b6202 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 38160 microversion: 2.1 time: 2.472501 Dec 07 18:50:50.866696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 489/957] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:48 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 38160 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:50.874077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-acd01669-9076-4238-bc66-518ee8060ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 28687 microversion: 2.20 time: 2.444892 Dec 07 18:50:50.874719 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 469/958] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:48 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 28687 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:51.877710 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-383af142-c822-45da-b0e0-610924118776 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:51.878749 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-383af142-c822-45da-b0e0-610924118776 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:51.884805 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9348fd45-c573-44a4-aac0-0117856da9c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:51.885798 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9348fd45-c573-44a4-aac0-0117856da9c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:51.886307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-383af142-c822-45da-b0e0-610924118776 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:51.886761 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-383af142-c822-45da-b0e0-610924118776 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:51.887538 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-383af142-c822-45da-b0e0-610924118776 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:51.888064 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-383af142-c822-45da-b0e0-610924118776 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:51.893461 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9348fd45-c573-44a4-aac0-0117856da9c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:51.893973 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9348fd45-c573-44a4-aac0-0117856da9c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:51.894782 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9348fd45-c573-44a4-aac0-0117856da9c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:51.895216 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9348fd45-c573-44a4-aac0-0117856da9c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:51.953138 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-383af142-c822-45da-b0e0-610924118776 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 38160 microversion: 2.1 time: 0.079342 Dec 07 18:50:51.953814 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 490/959] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:51 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 38160 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 07 18:50:51.976541 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9348fd45-c573-44a4-aac0-0117856da9c9 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 30217 microversion: 2.20 time: 0.095555 Dec 07 18:50:51.977661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 470/960] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:51 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 30217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:52.965011 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ec1bc68f-b72b-4da7-919b-7d1b8ddd670f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:52.966045 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ec1bc68f-b72b-4da7-919b-7d1b8ddd670f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:52.972842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec1bc68f-b72b-4da7-919b-7d1b8ddd670f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:52.973293 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec1bc68f-b72b-4da7-919b-7d1b8ddd670f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:52.974094 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec1bc68f-b72b-4da7-919b-7d1b8ddd670f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:52.974532 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ec1bc68f-b72b-4da7-919b-7d1b8ddd670f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:52.988697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-52b2bb26-2a4d-4343-8b41-f4bd2ea27fc0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:52.989716 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-52b2bb26-2a4d-4343-8b41-f4bd2ea27fc0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:52.996442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52b2bb26-2a4d-4343-8b41-f4bd2ea27fc0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:52.996888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52b2bb26-2a4d-4343-8b41-f4bd2ea27fc0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:52.998543 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52b2bb26-2a4d-4343-8b41-f4bd2ea27fc0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:52.998976 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52b2bb26-2a4d-4343-8b41-f4bd2ea27fc0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:53.055027 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ec1bc68f-b72b-4da7-919b-7d1b8ddd670f tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action" status: 200 len: 38291 microversion: 2.1 time: 0.093862 Dec 07 18:50:53.055677 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 491/961] 10.222.0.41 () {60 vars in 1277 bytes} [Tue Dec 7 18:50:52 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/action => generated 38291 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:50:53.065936 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-416d98eb-b112-4d85-90c4-39633a2e5ed4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:50:53.066509 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-416d98eb-b112-4d85-90c4-39633a2e5ed4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:53.073271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-416d98eb-b112-4d85-90c4-39633a2e5ed4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:53.073713 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-416d98eb-b112-4d85-90c4-39633a2e5ed4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:53.074607 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-416d98eb-b112-4d85-90c4-39633a2e5ed4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:53.075069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-416d98eb-b112-4d85-90c4-39633a2e5ed4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:53.084913 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-52b2bb26-2a4d-4343-8b41-f4bd2ea27fc0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 31605 microversion: 2.20 time: 0.100141 Dec 07 18:50:53.088862 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 471/962] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:52 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 31605 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:53.100808 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-416d98eb-b112-4d85-90c4-39633a2e5ed4 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/ips" status: 200 len: 147 microversion: 2.1 time: 0.038666 Dec 07 18:50:53.101383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 492/963] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Dec 7 18:50:53 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:50:54.151953 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cbbcd6c4-b18a-4f8e-b5f4-dfea86c76ec2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:54.153022 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cbbcd6c4-b18a-4f8e-b5f4-dfea86c76ec2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:54.161222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cbbcd6c4-b18a-4f8e-b5f4-dfea86c76ec2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:54.161698 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cbbcd6c4-b18a-4f8e-b5f4-dfea86c76ec2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:54.162661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cbbcd6c4-b18a-4f8e-b5f4-dfea86c76ec2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:54.165824 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cbbcd6c4-b18a-4f8e-b5f4-dfea86c76ec2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:54.248974 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cbbcd6c4-b18a-4f8e-b5f4-dfea86c76ec2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 33122 microversion: 2.20 time: 0.155304 Dec 07 18:50:54.249656 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 472/964] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:54 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 33122 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:54.337380 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c76b1489-f0cb-4cef-82ab-3d6f2bf7419e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd09a172-deff-4131-ba61-b1b8112b52c1"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:54.338468 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c76b1489-f0cb-4cef-82ab-3d6f2bf7419e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:54.344787 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c76b1489-f0cb-4cef-82ab-3d6f2bf7419e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:54.345532 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c76b1489-f0cb-4cef-82ab-3d6f2bf7419e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:54.346449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c76b1489-f0cb-4cef-82ab-3d6f2bf7419e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:54.346886 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c76b1489-f0cb-4cef-82ab-3d6f2bf7419e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:54.579682 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c76b1489-f0cb-4cef-82ab-3d6f2bf7419e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245889 Dec 07 18:50:54.580300 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 493/965] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:50:54 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:50:55.260881 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5898cb3c-ced9-493b-8a0d-63f4e423993a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:55.261900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5898cb3c-ced9-493b-8a0d-63f4e423993a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:55.269387 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5898cb3c-ced9-493b-8a0d-63f4e423993a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:55.269830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5898cb3c-ced9-493b-8a0d-63f4e423993a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:55.270634 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5898cb3c-ced9-493b-8a0d-63f4e423993a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:55.271066 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5898cb3c-ced9-493b-8a0d-63f4e423993a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:55.344213 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5898cb3c-ced9-493b-8a0d-63f4e423993a tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 33781 microversion: 2.20 time: 0.087067 Dec 07 18:50:55.344774 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 473/966] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:55 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 33781 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:56.357280 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2ce3c257-8c52-4ecd-8e16-de1c123d3b4f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:56.358852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2ce3c257-8c52-4ecd-8e16-de1c123d3b4f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:56.364992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ce3c257-8c52-4ecd-8e16-de1c123d3b4f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:56.365437 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ce3c257-8c52-4ecd-8e16-de1c123d3b4f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:56.366236 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ce3c257-8c52-4ecd-8e16-de1c123d3b4f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:56.366662 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ce3c257-8c52-4ecd-8e16-de1c123d3b4f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:56.440699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2ce3c257-8c52-4ecd-8e16-de1c123d3b4f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 34861 microversion: 2.20 time: 0.088150 Dec 07 18:50:56.441352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 494/967] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:56 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 34861 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:57.452565 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0ac8fff3-ce7f-4308-87fb-633611399126 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:57.453568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0ac8fff3-ce7f-4308-87fb-633611399126 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:57.460478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ac8fff3-ce7f-4308-87fb-633611399126 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:57.460928 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ac8fff3-ce7f-4308-87fb-633611399126 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:57.461701 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ac8fff3-ce7f-4308-87fb-633611399126 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:57.462166 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0ac8fff3-ce7f-4308-87fb-633611399126 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:57.552778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0ac8fff3-ce7f-4308-87fb-633611399126 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 35926 microversion: 2.20 time: 0.104388 Dec 07 18:50:57.553710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 474/968] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:57 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 35926 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:50:58.565038 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6ba4d677-7212-43da-ab21-146933b02688 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:58.566063 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6ba4d677-7212-43da-ab21-146933b02688 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:58.572780 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6ba4d677-7212-43da-ab21-146933b02688 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:58.573226 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6ba4d677-7212-43da-ab21-146933b02688 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:58.574014 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6ba4d677-7212-43da-ab21-146933b02688 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:58.574438 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6ba4d677-7212-43da-ab21-146933b02688 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:58.651449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6ba4d677-7212-43da-ab21-146933b02688 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 37397 microversion: 2.20 time: 0.090365 Dec 07 18:50:58.652065 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 495/969] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:58 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 37397 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:50:59.664201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a90d9a7d-d03c-4930-939c-087e6c63db57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:50:59.665205 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a90d9a7d-d03c-4930-939c-087e6c63db57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:50:59.672077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a90d9a7d-d03c-4930-939c-087e6c63db57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:59.672514 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a90d9a7d-d03c-4930-939c-087e6c63db57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:59.673537 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a90d9a7d-d03c-4930-939c-087e6c63db57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:50:59.673980 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a90d9a7d-d03c-4930-939c-087e6c63db57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:50:59.749212 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a90d9a7d-d03c-4930-939c-087e6c63db57 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 38244 microversion: 2.20 time: 0.088923 Dec 07 18:50:59.749827 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 475/970] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:50:59 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 38244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:51:00.761382 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e744cea5-d29a-4239-9fac-7ea1b289b5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:00.762536 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e744cea5-d29a-4239-9fac-7ea1b289b5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:00.770533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e744cea5-d29a-4239-9fac-7ea1b289b5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:00.770992 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e744cea5-d29a-4239-9fac-7ea1b289b5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:00.771767 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e744cea5-d29a-4239-9fac-7ea1b289b5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:00.772278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e744cea5-d29a-4239-9fac-7ea1b289b5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:00.847245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e744cea5-d29a-4239-9fac-7ea1b289b5fb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 38244 microversion: 2.20 time: 0.089754 Dec 07 18:51:00.851441 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 496/971] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:51:00 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 38244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:51:00.995554 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bfe84e26-8e1e-44e1-b15d-2fc94e49e2e6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:00.996536 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bfe84e26-8e1e-44e1-b15d-2fc94e49e2e6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:01.003900 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfe84e26-8e1e-44e1-b15d-2fc94e49e2e6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:01.004342 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfe84e26-8e1e-44e1-b15d-2fc94e49e2e6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:01.005100 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfe84e26-8e1e-44e1-b15d-2fc94e49e2e6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:01.005528 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bfe84e26-8e1e-44e1-b15d-2fc94e49e2e6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:01.034439 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bfe84e26-8e1e-44e1-b15d-2fc94e49e2e6 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 Dec 07 18:51:01.034912 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 476/972] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:51:00 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:01.045239 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f3884256-c5d5-44e5-872c-3e0a0db67762 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:01.045931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f3884256-c5d5-44e5-872c-3e0a0db67762 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:01.053026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3884256-c5d5-44e5-872c-3e0a0db67762 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:01.053479 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3884256-c5d5-44e5-872c-3e0a0db67762 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:01.054280 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3884256-c5d5-44e5-872c-3e0a0db67762 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:01.054715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f3884256-c5d5-44e5-872c-3e0a0db67762 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:01.083704 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f3884256-c5d5-44e5-872c-3e0a0db67762 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/cd09a172-deff-4131-ba61-b1b8112b52c1" status: 200 len: 194 microversion: 2.1 time: 0.042835 Dec 07 18:51:01.084278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 497/973] 10.222.0.41 () {58 vars in 1412 bytes} [Tue Dec 7 18:51:01 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/cd09a172-deff-4131-ba61-b1b8112b52c1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:01.859507 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ffa9e3a2-1aef-4c0a-839e-e2f0f2c06791 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:01.860426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ffa9e3a2-1aef-4c0a-839e-e2f0f2c06791 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:01.866704 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffa9e3a2-1aef-4c0a-839e-e2f0f2c06791 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:01.867154 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffa9e3a2-1aef-4c0a-839e-e2f0f2c06791 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:01.867924 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffa9e3a2-1aef-4c0a-839e-e2f0f2c06791 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:01.868539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ffa9e3a2-1aef-4c0a-839e-e2f0f2c06791 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:01.931289 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ffa9e3a2-1aef-4c0a-839e-e2f0f2c06791 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 38244 microversion: 2.20 time: 0.075949 Dec 07 18:51:01.935997 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 477/974] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:51:01 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 38244 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:51:02.322125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-35572ea9-bb93-4660-9304-0b70e3390a10 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c13cf53-a5ee-4203-8679-a49cba0fa07b"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:02.323205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-35572ea9-bb93-4660-9304-0b70e3390a10 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:02.330018 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35572ea9-bb93-4660-9304-0b70e3390a10 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:02.330471 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35572ea9-bb93-4660-9304-0b70e3390a10 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:02.331261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35572ea9-bb93-4660-9304-0b70e3390a10 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:02.331695 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35572ea9-bb93-4660-9304-0b70e3390a10 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:02.573156 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-35572ea9-bb93-4660-9304-0b70e3390a10 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254832 Dec 07 18:51:02.573759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 498/975] 10.222.0.41 () {60 vars in 1322 bytes} [Tue Dec 7 18:51:02 2021] POST /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:02.944630 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c675a604-adc6-47e1-999a-abe0384ed31c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:02.945624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c675a604-adc6-47e1-999a-abe0384ed31c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:02.952734 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c675a604-adc6-47e1-999a-abe0384ed31c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:02.953178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c675a604-adc6-47e1-999a-abe0384ed31c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:02.953976 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c675a604-adc6-47e1-999a-abe0384ed31c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:02.954411 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c675a604-adc6-47e1-999a-abe0384ed31c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:03.026382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c675a604-adc6-47e1-999a-abe0384ed31c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 38244 microversion: 2.20 time: 0.085937 Dec 07 18:51:03.027033 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 478/976] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:51:02 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 38244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:51:04.038688 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c81ffaeb-9d55-4ee8-aec6-249526ab5f3d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:04.039713 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c81ffaeb-9d55-4ee8-aec6-249526ab5f3d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:04.046770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c81ffaeb-9d55-4ee8-aec6-249526ab5f3d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:04.047223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c81ffaeb-9d55-4ee8-aec6-249526ab5f3d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:04.048266 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c81ffaeb-9d55-4ee8-aec6-249526ab5f3d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:04.048699 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c81ffaeb-9d55-4ee8-aec6-249526ab5f3d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:04.122403 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c81ffaeb-9d55-4ee8-aec6-249526ab5f3d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 200 len: 38387 microversion: 2.20 time: 0.087516 Dec 07 18:51:04.123665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 499/977] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:51:04 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 38387 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:51:04.133878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8842c916-886b-433f-8c0e-fc405f411ab4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:04.134484 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8842c916-886b-433f-8c0e-fc405f411ab4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:04.141484 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8842c916-886b-433f-8c0e-fc405f411ab4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:04.141952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8842c916-886b-433f-8c0e-fc405f411ab4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:04.142724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8842c916-886b-433f-8c0e-fc405f411ab4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:04.143155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8842c916-886b-433f-8c0e-fc405f411ab4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:04.166073 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8842c916-886b-433f-8c0e-fc405f411ab4 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/ips" status: 200 len: 153 microversion: 2.20 time: 0.036194 Dec 07 18:51:04.166637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 479/978] 10.222.0.41 () {60 vars in 1288 bytes} [Tue Dec 7 18:51:04 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:51:06.136630 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:06.137168 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:06.144037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:06.144480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:06.145232 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:06.145657 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:06.168612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lazy-loading 'flavor' on Instance uuid 017abb4f-1da1-4373-83da-f4e5b0d2516b {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:51:06.422305 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-67e4a10b-9dae-483a-bed3-0af622d5664b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 202 len: 0 microversion: 2.20 time: 0.289682 Dec 07 18:51:06.423351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 500/979] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:51:06 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:51:06.432546 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:06.433166 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:06.440459 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:06.440909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:06.442614 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:06.443064 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:06.577326 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:06.585014 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:06.586546 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:06.587699 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2644be0c-f37e-4b8a-bb78-3860b3f3af2b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.160321 Dec 07 18:51:06.588268 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 480/980] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:06 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:07.606893 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:07.607647 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:07.614306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:07.614749 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:07.615508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:07.615931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:07.744832 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:07.752938 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:07.754451 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:07.755588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6e28efa4-c46d-42c3-8386-39fb1e36b3f5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.153200 Dec 07 18:51:07.756138 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 501/981] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:07 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:08.774068 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:08.774677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:08.780922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:08.781370 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:08.782162 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:08.782592 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:08.911955 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:08.920160 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:08.921838 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:08.923385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c84896fe-54bd-472c-b468-2fc49f8f7d9b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.153054 Dec 07 18:51:08.923949 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 481/982] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:08 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:09.942911 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:09.943511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:09.949719 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:09.950191 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:09.951180 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:09.952022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:10.036813 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b7ad84a6-4e99-4057-b1cf-96c8bb671a5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:10.037729 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b7ad84a6-4e99-4057-b1cf-96c8bb671a5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:10.044009 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b7ad84a6-4e99-4057-b1cf-96c8bb671a5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:10.044467 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b7ad84a6-4e99-4057-b1cf-96c8bb671a5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:10.046142 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b7ad84a6-4e99-4057-b1cf-96c8bb671a5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:10.046580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b7ad84a6-4e99-4057-b1cf-96c8bb671a5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:10.076547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b7ad84a6-4e99-4057-b1cf-96c8bb671a5d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042862 Dec 07 18:51:10.077123 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 482/983] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:51:10 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:51:10.083327 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:10.091143 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:10.092891 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:10.094104 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9d52b38b-0b25-4de6-871b-3930d55b8c2f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.154847 Dec 07 18:51:10.094664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 502/984] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:09 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:11.111491 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:11.112093 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:11.118454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:11.118905 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:11.119677 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:11.120108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:11.249232 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:11.256931 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:11.258449 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:11.259588 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c09b4d8f-eb89-4de0-99b6-8907e24a1361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.152101 Dec 07 18:51:11.260142 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 483/985] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:11 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:12.277596 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:12.278206 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:12.284405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:12.284849 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:12.285611 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:12.286059 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:12.420533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:12.428523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:12.430068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:12.431228 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dd65549c-cec4-4b40-86b5-ed8316bd0ff5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.157364 Dec 07 18:51:12.431791 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 503/986] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:12 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:13.449869 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:13.450495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:13.457093 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:13.457539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:13.458353 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:13.458778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:13.590207 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:13.598541 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:13.600018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:13.601159 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d23d4135-02e4-4700-b79d-14b7ae98c26b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.155006 Dec 07 18:51:13.601716 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 484/987] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:13 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:14.619882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:14.620421 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:14.627399 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:14.627840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:14.628598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:14.629019 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:14.758378 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:14.766484 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:14.767998 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:14.769139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ee3aed8e-8a00-4f88-bd0d-8b4969f50456 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.153083 Dec 07 18:51:14.769696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 504/988] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:14 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:15.787147 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:15.787754 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:15.794109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:15.795179 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:15.795947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:15.796383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:15.922310 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:15.930158 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:15.931662 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:15.932803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a776abc9-1aeb-42e2-82c1-318e9af120fd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.149344 Dec 07 18:51:15.933363 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 485/989] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:15 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:16.951384 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:16.951996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:16.958415 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:16.958861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:16.959627 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:16.960057 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:17.100244 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:17.108524 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:17.110079 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:17.111349 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-813c64df-a01d-4e2a-b30b-bf22e418291b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1747 microversion: 2.20 time: 0.164326 Dec 07 18:51:17.111922 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 505/990] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:16 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:18.129568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:18.130291 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:18.136573 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:18.137017 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:18.137779 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:18.138909 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:18.273058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:18.281251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:18.282796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:18.283952 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ea226540-c97c-4f12-8973-8b6a82d6e6dd tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1747 microversion: 2.20 time: 0.158136 Dec 07 18:51:18.284519 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 486/991] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:18 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:19.312432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:19.314113 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:19.320869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:19.321607 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:19.322485 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:19.322977 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:19.468000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:19.476068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:19.477933 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:19.480009 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-05419678-1643-4f3c-b109-046211ef4d23 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.181970 Dec 07 18:51:19.491249 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 506/992] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:19 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:20.125453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-a1dc18e3-e945-4ef7-b68f-2f900ddf013b req-a6437b90-00dd-4bad-9c37-498e67a7184a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017abb4f-1da1-4373-83da-f4e5b0d2516b", "name": "network-vif-plugged", "status": "completed", "tag": "9d321fb6-c496-4034-a6c7-7c7410c908b0"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:20.127942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:51:20.127942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:51:20.135032 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-a1dc18e3-e945-4ef7-b68f-2f900ddf013b req-a6437b90-00dd-4bad-9c37-498e67a7184a service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:20.135687 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-a1dc18e3-e945-4ef7-b68f-2f900ddf013b req-a6437b90-00dd-4bad-9c37-498e67a7184a service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:20.150629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-a1dc18e3-e945-4ef7-b68f-2f900ddf013b req-a6437b90-00dd-4bad-9c37-498e67a7184a service nova] Creating event network-vif-plugged:9d321fb6-c496-4034-a6c7-7c7410c908b0 for instance 017abb4f-1da1-4373-83da-f4e5b0d2516b on hv-cinder-81969 Dec 07 18:51:20.156595 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-a1dc18e3-e945-4ef7-b68f-2f900ddf013b req-a6437b90-00dd-4bad-9c37-498e67a7184a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038008 Dec 07 18:51:20.157827 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 487/993] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:20.500703 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:20.501378 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:20.508652 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:20.509459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:20.510419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:20.510858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:20.668319 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:20.678273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:20.679782 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:20.681208 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f16b6e9a-5355-4351-9d3b-fb8768cac2c7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.186199 Dec 07 18:51:20.682290 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 507/994] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:20 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:21.699859 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:21.702019 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:21.711453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:21.712227 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:21.713002 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:21.713598 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:21.856379 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:21.865454 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:21.867063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:21.868255 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-abb92c88-19ac-4180-b31f-11fe7d13d01c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.172621 Dec 07 18:51:21.868833 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 488/995] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:21 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:51:22.889873 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:22.892119 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:22.901676 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:22.902339 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:22.903134 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:22.903869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:23.078075 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:23.088717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:23.090274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:23.091538 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0dabe900-408c-4f28-9929-4cbee2054eb1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.205668 Dec 07 18:51:23.098100 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 508/996] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:22 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:24.110201 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:24.111067 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:24.118984 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:24.119545 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:24.120411 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:24.120842 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:24.267479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:24.275452 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:24.277013 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:24.278319 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4bf8638f-4872-4b1a-a0d8-8def95cd01a8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.172375 Dec 07 18:51:24.279556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 489/997] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:24 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:25.297884 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:25.298511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:25.305367 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:25.306160 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:25.307023 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:25.307465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:25.457288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:25.465633 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:25.471516 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:25.473005 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-49974493-77b0-40bf-80eb-8ff1df4d3a67 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.180215 Dec 07 18:51:25.474137 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 509/998] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:25 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:25.542075 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9659dec2-d2ab-4ec1-9c5e-f6b42986a964 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:25.543308 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9659dec2-d2ab-4ec1-9c5e-f6b42986a964 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:25.550465 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9659dec2-d2ab-4ec1-9c5e-f6b42986a964 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:25.551129 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9659dec2-d2ab-4ec1-9c5e-f6b42986a964 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:25.552118 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9659dec2-d2ab-4ec1-9c5e-f6b42986a964 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:25.552562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9659dec2-d2ab-4ec1-9c5e-f6b42986a964 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:25.582719 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9659dec2-d2ab-4ec1-9c5e-f6b42986a964 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/cd09a172-deff-4131-ba61-b1b8112b52c1" status: 200 len: 194 microversion: 2.1 time: 0.044376 Dec 07 18:51:25.583572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 490/999] 10.222.0.41 () {58 vars in 1412 bytes} [Tue Dec 7 18:51:25 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/cd09a172-deff-4131-ba61-b1b8112b52c1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:25.594829 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:25.595327 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:25.601353 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:25.601860 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:25.602787 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:25.603282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:25.701822 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lazy-loading 'services' on Instance uuid 0223b4da-cb69-4ac7-834e-04eb11b904fa {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:51:25.785668 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5bd19ad6-33ad-41b6-b348-7538a9402b63 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/cd09a172-deff-4131-ba61-b1b8112b52c1" status: 202 len: 0 microversion: 2.1 time: 0.195464 Dec 07 18:51:25.790908 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 510/1000] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:51:25 2021] DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/cd09a172-deff-4131-ba61-b1b8112b52c1 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:51:26.492364 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:26.492976 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:26.499713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:26.500171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:26.501010 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:26.501441 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:26.664074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:26.675034 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:26.680298 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:26.681898 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c4a28d09-054d-47d5-816a-22d0ba4cc805 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.193346 Dec 07 18:51:26.682967 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 491/1001] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:26 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:51:26.912391 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3e00e9db-ba79-42c4-aafb-9a7598c1bdf5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:26.913644 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3e00e9db-ba79-42c4-aafb-9a7598c1bdf5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:26.920755 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e00e9db-ba79-42c4-aafb-9a7598c1bdf5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:26.921405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e00e9db-ba79-42c4-aafb-9a7598c1bdf5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:26.922646 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e00e9db-ba79-42c4-aafb-9a7598c1bdf5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:26.923073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3e00e9db-ba79-42c4-aafb-9a7598c1bdf5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:26.957235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3e00e9db-ba79-42c4-aafb-9a7598c1bdf5 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/4c13cf53-a5ee-4203-8679-a49cba0fa07b" status: 200 len: 194 microversion: 2.1 time: 0.049493 Dec 07 18:51:26.958038 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 511/1002] 10.222.0.41 () {58 vars in 1412 bytes} [Tue Dec 7 18:51:26 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/4c13cf53-a5ee-4203-8679-a49cba0fa07b => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:26.967376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:26.968248 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:26.974622 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:26.975146 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:26.976018 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:26.976645 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:27.064466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lazy-loading 'services' on Instance uuid 0223b4da-cb69-4ac7-834e-04eb11b904fa {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:51:27.146813 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-43be114d-6083-4f99-a582-0698515e1aca tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/4c13cf53-a5ee-4203-8679-a49cba0fa07b" status: 202 len: 0 microversion: 2.1 time: 0.182998 Dec 07 18:51:27.150793 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 492/1003] 10.222.0.41 () {58 vars in 1415 bytes} [Tue Dec 7 18:51:26 2021] DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments/4c13cf53-a5ee-4203-8679-a49cba0fa07b => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 07 18:51:27.702310 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:27.703367 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:27.710725 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:27.711552 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:27.712704 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:27.714035 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:27.893502 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:27.903934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:27.907509 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:27.909810 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e328752e-4113-41fb-b06c-dc3d1f735a7c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1742 microversion: 2.20 time: 0.211878 Dec 07 18:51:27.910646 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 512/1004] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:27 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1742 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:28.305836 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3cf10aef-bb29-4e79-ac33-e8966585d92c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:28.306904 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3cf10aef-bb29-4e79-ac33-e8966585d92c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:28.313279 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3cf10aef-bb29-4e79-ac33-e8966585d92c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.313731 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3cf10aef-bb29-4e79-ac33-e8966585d92c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.314533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3cf10aef-bb29-4e79-ac33-e8966585d92c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.314968 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3cf10aef-bb29-4e79-ac33-e8966585d92c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.348011 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3cf10aef-bb29-4e79-ac33-e8966585d92c tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046835 Dec 07 18:51:28.348579 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 493/1005] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:51:28 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:51:28.446638 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-87a99edd-ceac-4def-9c6f-7bef913ed083 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:28.447591 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-87a99edd-ceac-4def-9c6f-7bef913ed083 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:28.454453 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a99edd-ceac-4def-9c6f-7bef913ed083 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.454906 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a99edd-ceac-4def-9c6f-7bef913ed083 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.455661 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a99edd-ceac-4def-9c6f-7bef913ed083 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.456090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87a99edd-ceac-4def-9c6f-7bef913ed083 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.484068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-87a99edd-ceac-4def-9c6f-7bef913ed083 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041196 Dec 07 18:51:28.484612 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 513/1006] 10.222.0.41 () {58 vars in 1301 bytes} [Tue Dec 7 18:51:28 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 07 18:51:28.538774 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:28.539290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:28.544942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.545383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.546169 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.546595 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.570379 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:51:28.641363 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f609486e-d2f2-4e0e-801e-5ce1ccc838ff tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 204 len: 0 microversion: 2.1 time: 0.105852 Dec 07 18:51:28.642243 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 494/1007] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:51:28 2021] DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:51:28.649858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:28.650490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:28.657493 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.657976 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.658762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.659215 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.824052 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:28.832380 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a5b9834f-22bc-4b6a-a77b-46c8536464bb tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1675 microversion: 2.1 time: 0.186182 Dec 07 18:51:28.832959 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 514/1008] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:28 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:51:28.929377 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:28.930091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:28.936427 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.936867 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:28.937630 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:28.938088 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:29.069414 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:29.077727 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:29.079265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:29.080457 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-344eb704-8a42-490f-9b3b-c397e0bfbd89 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1724 microversion: 2.20 time: 0.155161 Dec 07 18:51:29.081026 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 495/1009] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:28 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:29.850278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:29.850879 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:29.857665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:29.858140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:29.858903 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:29.859326 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:29.991427 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:29.998710 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5f6de6b8-c6d6-4711-9e3c-4e1944e26408 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1675 microversion: 2.1 time: 0.152170 Dec 07 18:51:29.999274 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 515/1010] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:29 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:51:30.098806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:30.099407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:30.105731 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:30.106156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:30.107629 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:30.108079 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:30.244473 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:30.252235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:30.253756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:30.254917 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b2c638d2-3d67-466a-9dc6-b9a9214c4b51 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1724 microversion: 2.20 time: 0.159799 Dec 07 18:51:30.255483 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 496/1011] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:30 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:31.016664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:31.017286 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:31.023799 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.024245 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.025020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.025445 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.257813 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87d73e143d814bd6b6b09961603410b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb0144e924847109e6a254192f1e6bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:31.266902 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-d4c6eaae-8bce-4e7d-9fca-740b41d211cf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 200 len: 1675 microversion: 2.1 time: 0.254193 Dec 07 18:51:31.267520 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 516/1012] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:31 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:51:31.272471 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:31.273188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:31.279817 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.280407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.281383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.281968 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.441463 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:31.449135 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:31.451589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:31.452830 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a7a2fd41-63bc-41f3-8bd7-ca607546695c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1727 microversion: 2.20 time: 0.184031 Dec 07 18:51:31.453444 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 497/1013] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:31 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:31.471190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6697dd17-2aa7-461c-abef-8d4a7b74415b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "255383f1-da0d-4e7c-9402-77a09bc850b5"}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:31.472284 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-6697dd17-2aa7-461c-abef-8d4a7b74415b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:31.478113 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6697dd17-2aa7-461c-abef-8d4a7b74415b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.478564 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6697dd17-2aa7-461c-abef-8d4a7b74415b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.479337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6697dd17-2aa7-461c-abef-8d4a7b74415b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.479776 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-6697dd17-2aa7-461c-abef-8d4a7b74415b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.637188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-d1bab355-b844-42fd-9f86-8be7b8fe18eb req-e559c8cf-7c9b-4e21-bf1c-04fe232d4f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0223b4da-cb69-4ac7-834e-04eb11b904fa", "name": "network-vif-deleted", "tag": "c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:31.639139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:51:31.639139 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:51:31.646138 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d1bab355-b844-42fd-9f86-8be7b8fe18eb req-e559c8cf-7c9b-4e21-bf1c-04fe232d4f5f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.646578 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d1bab355-b844-42fd-9f86-8be7b8fe18eb req-e559c8cf-7c9b-4e21-bf1c-04fe232d4f5f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.660462 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-d1bab355-b844-42fd-9f86-8be7b8fe18eb req-e559c8cf-7c9b-4e21-bf1c-04fe232d4f5f service nova] Creating event network-vif-deleted:c32b395a-3e2d-4f29-9b1c-0d9061f7bc4b for instance 0223b4da-cb69-4ac7-834e-04eb11b904fa on hv-cinder-81969 Dec 07 18:51:31.665484 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-d1bab355-b844-42fd-9f86-8be7b8fe18eb req-e559c8cf-7c9b-4e21-bf1c-04fe232d4f5f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031786 Dec 07 18:51:31.666480 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 498/1014] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:51:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:51:31.818619 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6697dd17-2aa7-461c-abef-8d4a7b74415b tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.351537 Dec 07 18:51:31.819918 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 517/1015] 10.222.0.41 () {62 vars in 1363 bytes} [Tue Dec 7 18:51:31 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-volume_attachments => generated 188 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 07 18:51:31.932939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7c70c2ac-f707-4b2e-9dc2-b926a9d42dfb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:31.933570 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7c70c2ac-f707-4b2e-9dc2-b926a9d42dfb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:31.940520 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7c70c2ac-f707-4b2e-9dc2-b926a9d42dfb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.941080 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7c70c2ac-f707-4b2e-9dc2-b926a9d42dfb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:31.941852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7c70c2ac-f707-4b2e-9dc2-b926a9d42dfb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:31.942327 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7c70c2ac-f707-4b2e-9dc2-b926a9d42dfb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.191662 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7c70c2ac-f707-4b2e-9dc2-b926a9d42dfb tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-volume_attachments/255383f1-da0d-4e7c-9402-77a09bc850b5" status: 202 len: 0 microversion: 2.20 time: 0.262699 Dec 07 18:51:32.192346 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 499/1016] 10.222.0.41 () {60 vars in 1456 bytes} [Tue Dec 7 18:51:31 2021] DELETE /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-volume_attachments/255383f1-da0d-4e7c-9402-77a09bc850b5 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:51:32.246530 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9b19d98d-c2ef-450a-bd88-c31774f8f1f1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:32.247876 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9b19d98d-c2ef-450a-bd88-c31774f8f1f1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:32.254104 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9b19d98d-c2ef-450a-bd88-c31774f8f1f1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:32.254557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9b19d98d-c2ef-450a-bd88-c31774f8f1f1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.255338 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9b19d98d-c2ef-450a-bd88-c31774f8f1f1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:32.255773 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9b19d98d-c2ef-450a-bd88-c31774f8f1f1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.284335 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:32.284938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:32.292404 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:32.292858 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.293619 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:32.294388 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.307970 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] HTTP exception thrown: Instance 0223b4da-cb69-4ac7-834e-04eb11b904fa could not be found. Dec 07 18:51:32.308559 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Returning 404 to user: Instance 0223b4da-cb69-4ac7-834e-04eb11b904fa could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:32.309386 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7683a9d3-8672-4695-bf30-65a92f864e8d tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 404 len: 111 microversion: 2.1 time: 0.029347 Dec 07 18:51:32.310477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 500/1017] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:32 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:51:32.319283 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-417649c3-df59-4b1e-bc79-29fee7a2654b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '.version_select at 0x7f1998103550>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:32.338035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-417649c3-df59-4b1e-bc79-29fee7a2654b tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207875598" status: 202 len: 0 microversion: 2.1 time: 0.022628 Dec 07 18:51:32.338605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 501/1018] 10.222.0.41 () {58 vars in 1220 bytes} [Tue Dec 7 18:51:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207875598 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:51:32.352027 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9b19d98d-c2ef-450a-bd88-c31774f8f1f1 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action" status: 202 len: 0 microversion: 2.20 time: 0.109141 Dec 07 18:51:32.358745 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 518/1019] 10.222.0.41 () {62 vars in 1318 bytes} [Tue Dec 7 18:51:32 2021] POST /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:51:32.364942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-8677adae-9bdf-41a9-a65b-dcdea890634b req-4b373ee8-2554-4eb7-9b82-9147d984fb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017abb4f-1da1-4373-83da-f4e5b0d2516b", "name": "network-vif-unplugged", "status": "completed", "tag": "9d321fb6-c496-4034-a6c7-7c7410c908b0"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:32.366023 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:32.366822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:51:32.366822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:51:32.367188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:32.376373 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:32.377044 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.378191 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:32.379341 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.379473 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-8677adae-9bdf-41a9-a65b-dcdea890634b req-4b373ee8-2554-4eb7-9b82-9147d984fb87 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:32.379829 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-8677adae-9bdf-41a9-a65b-dcdea890634b req-4b373ee8-2554-4eb7-9b82-9147d984fb87 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:32.410717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.compute.server_external_events [req-8677adae-9bdf-41a9-a65b-dcdea890634b req-4b373ee8-2554-4eb7-9b82-9147d984fb87 service nova] Unable to find a host for instance 017abb4f-1da1-4373-83da-f4e5b0d2516b. Dropping event network-vif-unplugged {{(pid=122586) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 07 18:51:32.411635 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-8677adae-9bdf-41a9-a65b-dcdea890634b req-4b373ee8-2554-4eb7-9b82-9147d984fb87 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.071948 Dec 07 18:51:32.412883 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 502/1020] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:51:32 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 07 18:51:32.588673 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:32.599967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:32.602037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:32.603557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-21d3118e-9f94-4023-bb9e-ffeb623ae113 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1675 microversion: 2.20 time: 0.243589 Dec 07 18:51:32.604678 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 519/1021] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:32 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:33.629504 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:33.630136 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:33.636282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:33.636728 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:33.637501 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:33.638081 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:33.776572 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:33.785986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:33.787486 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:33.788847 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-99933987-b552-4f0f-aa8d-eaccbd43d612 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.163037 Dec 07 18:51:33.789404 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 503/1022] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:33 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:34.808230 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:34.809505 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:34.816777 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:34.817580 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:34.818629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:34.819319 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:34.970123 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:34.978600 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:34.980088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:34.982153 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-35abf4ca-a41e-4915-a5c2-4494fbbf862f tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.177208 Dec 07 18:51:34.983106 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 520/1023] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:34 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:35.674338 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:35.674873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:35.681069 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:35.681512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:35.682361 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:35.682747 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:35.845879 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] HTTP exception thrown: Instance 0223b4da-cb69-4ac7-834e-04eb11b904fa could not be found. Dec 07 18:51:35.846503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Returning 404 to user: Instance 0223b4da-cb69-4ac7-834e-04eb11b904fa could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:35.847332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-52559bd4-a431-4597-b5a6-2c467105c3ef tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 404 len: 111 microversion: 2.1 time: 0.176977 Dec 07 18:51:35.848077 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 504/1024] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:51:35 2021] DELETE /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:51:35.856169 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:35.857950 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 0223b4da-cb69-4ac7-834e-04eb11b904fa] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:35.864609 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:35.865157 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:35.866128 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:35.866634 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:35.880670 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] HTTP exception thrown: Instance 0223b4da-cb69-4ac7-834e-04eb11b904fa could not be found. Dec 07 18:51:35.881352 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Returning 404 to user: Instance 0223b4da-cb69-4ac7-834e-04eb11b904fa could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:35.882296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b1f0f5ea-18ba-415b-86ab-20e48585e64e tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa" status: 404 len: 111 microversion: 2.1 time: 0.030076 Dec 07 18:51:35.882925 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 521/1025] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:35 2021] GET /compute/v2.1/servers/0223b4da-cb69-4ac7-834e-04eb11b904fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:51:36.004495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:36.005190 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:36.011372 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:36.011924 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:36.014046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:36.014561 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:36.188840 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:36.197052 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:36.198598 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:36.199758 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c91bd797-bbd7-4129-9842-5fdac7c8bee5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.199180 Dec 07 18:51:36.202532 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 505/1026] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:35 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:51:37.031152 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:37.031689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:37.039459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:37.039908 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:37.040696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:37.041129 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:37.056442 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] HTTP exception thrown: Instance 668cc429-6322-4b0b-8f3a-6d910c891444 could not be found. Dec 07 18:51:37.057098 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Returning 404 to user: Instance 668cc429-6322-4b0b-8f3a-6d910c891444 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:37.057964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-71669133-171b-470b-bbac-a90635d701e8 tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "DELETE /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 404 len: 111 microversion: 2.1 time: 0.031254 Dec 07 18:51:37.058696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 522/1027] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:51:37 2021] DELETE /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:51:37.067247 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:37.067850 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] [instance: 668cc429-6322-4b0b-8f3a-6d910c891444] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:37.074275 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:37.074719 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:37.076272 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:37.076902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:37.094041 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] HTTP exception thrown: Instance 668cc429-6322-4b0b-8f3a-6d910c891444 could not be found. Dec 07 18:51:37.094744 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] Returning 404 to user: Instance 668cc429-6322-4b0b-8f3a-6d910c891444 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:37.095955 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a072bd0e-1cd8-41b5-a692-52399c6d0ddf tempest-AttachVolumeTestJSON-1544477341 tempest-AttachVolumeTestJSON-1544477341-project] 10.222.0.41 "GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444" status: 404 len: 111 microversion: 2.1 time: 0.032217 Dec 07 18:51:37.096726 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 506/1028] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:37 2021] GET /compute/v2.1/servers/668cc429-6322-4b0b-8f3a-6d910c891444 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:51:37.219331 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:37.219938 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:37.226020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:37.226795 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:37.227760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:37.228351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:37.516483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:37.524760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:37.526320 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:37.527483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0d25f9ad-1b8e-47c1-8d41-c3e0b948d80c tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.312573 Dec 07 18:51:37.528042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 523/1029] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:37 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:38.547474 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:38.548025 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:38.554853 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:38.555649 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:38.556635 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:38.557133 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:38.702724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:38.710958 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:38.712443 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:38.713595 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-34f840f0-9d25-4211-9d73-953359cc0461 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.171284 Dec 07 18:51:38.714172 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 507/1030] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:38 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:39.733155 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:39.733862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:39.749198 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:39.750192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:39.751842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:39.752519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:39.940316 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:39.963550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:39.966539 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:39.968182 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-764c9f07-acfb-4403-822f-0397d03f5f01 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.239027 Dec 07 18:51:39.969153 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 524/1031] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:39 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:40.992977 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:40.994262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:41.007396 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:41.008356 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:41.009407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:41.010129 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:41.286529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:41.287717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:41.296524 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:41.298458 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:41.301129 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:41.302202 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:41.391345 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:51:41.423793 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:41.439214 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:41.441762 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:41.454854 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-89265d8b-8b8b-45ae-a760-1863222bfb79 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.465832 Dec 07 18:51:41.460370 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 508/1032] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:40 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:41.482431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-8f7ca825-936e-4018-83ed-e9a5b2705d53 req-d13a58ae-6b21-4f8b-b8e8-7dcf59fde1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6353ff89-98cf-4e56-b677-b0f9431d7e1d", "tag": "ea0e7445-57e1-4ed8-b96b-ef483e19d0bd"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:41.487865 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:51:41.487865 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:51:41.527803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-8f7ca825-936e-4018-83ed-e9a5b2705d53 req-d13a58ae-6b21-4f8b-b8e8-7dcf59fde1f4 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:41.529703 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-8f7ca825-936e-4018-83ed-e9a5b2705d53 req-d13a58ae-6b21-4f8b-b8e8-7dcf59fde1f4 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:41.587397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-8f7ca825-936e-4018-83ed-e9a5b2705d53 req-d13a58ae-6b21-4f8b-b8e8-7dcf59fde1f4 service nova] Creating event network-changed:ea0e7445-57e1-4ed8-b96b-ef483e19d0bd for instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d on hv-cinder-81969 Dec 07 18:51:41.593672 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-8f7ca825-936e-4018-83ed-e9a5b2705d53 req-d13a58ae-6b21-4f8b-b8e8-7dcf59fde1f4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130412 Dec 07 18:51:41.595376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 509/1033] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:51:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:41.616102 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0e4a7883-d552-443f-8dd7-42b0ffa067c5 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 204 len: 0 microversion: 2.1 time: 0.332814 Dec 07 18:51:41.617437 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 525/1034] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:51:41 2021] DELETE /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 07 18:51:41.626720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:41.628194 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:41.649226 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:41.649804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:41.650841 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:41.651380 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:41.907380 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:41.918429 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-93262de8-7760-492c-b96a-cf69e7fabdd1 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.296255 Dec 07 18:51:41.920257 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 510/1035] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:41 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:51:42.479931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:42.482975 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:42.490465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:42.491009 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:42.491875 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:42.492374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:42.682295 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:42.693471 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:42.695335 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:42.696837 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b1b8e716-c411-465b-8735-c4dbcacc8171 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.221447 Dec 07 18:51:42.710720 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 526/1036] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:42 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:42.939632 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:42.941178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:42.948277 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:42.948769 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:42.949737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:42.950822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:43.123109 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:43.130577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a8e5b1e1-83a0-4ba2-bcae-50dee34a4a7b tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.197818 Dec 07 18:51:43.132773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 511/1037] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:42 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:51:43.256016 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cafb461d-ab2f-4ed6-a458-e76bcb6ee10c tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Action: 'create', calling method: .version_select at 0x7f198bf53430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-76190778", "metadata": {"Type": "work"}}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:43.257472 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cafb461d-ab2f-4ed6-a458-e76bcb6ee10c tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:43.258307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cafb461d-ab2f-4ed6-a458-e76bcb6ee10c tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.116986 Dec 07 18:51:43.258843 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 527/1038] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Dec 7 18:51:43 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 07 18:51:43.267962 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-816e7d5e-623b-4c65-a1f4-0e27268eb6fb tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Action: 'create', calling method: .version_select at 0x7f1998103940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-401158921", "metadata": {"Type": "work"}}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:43.269407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-816e7d5e-623b-4c65-a1f4-0e27268eb6fb tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:43.270237 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-816e7d5e-623b-4c65-a1f4-0e27268eb6fb tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005959 Dec 07 18:51:43.270758 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 512/1039] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Dec 7 18:51:43 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 07 18:51:43.279692 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e51d4938-35d3-4a40-b73e-853e1b40ce7b tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Action: 'create', calling method: .version_select at 0x7f199801b820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-807132232", "metadata": {"Type": "work"}}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:43.280889 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e51d4938-35d3-4a40-b73e-853e1b40ce7b tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:43.281683 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e51d4938-35d3-4a40-b73e-853e1b40ce7b tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005793 Dec 07 18:51:43.282235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 528/1040] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Dec 7 18:51:43 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 07 18:51:43.291713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-81796adb-e0f8-4724-bff6-c3397f627ca8 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Calling method '.version_select at 0x7f1998077310>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:43.320431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-81796adb-e0f8-4724-bff6-c3397f627ca8 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] HTTP exception thrown: Volume tempest-invalid-847525628 could not be found. Dec 07 18:51:43.321144 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-81796adb-e0f8-4724-bff6-c3397f627ca8 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Returning 404 to user: Volume tempest-invalid-847525628 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:43.321995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-81796adb-e0f8-4724-bff6-c3397f627ca8 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-847525628" status: 404 len: 98 microversion: 2.1 time: 0.033934 Dec 07 18:51:43.327574 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 513/1041] 10.222.0.41 () {58 vars in 1214 bytes} [Tue Dec 7 18:51:43 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-847525628 => generated 98 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 07 18:51:43.335103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-51b95bbe-0328-4a90-a9b1-b6ae6821720e tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006336 Dec 07 18:51:43.335626 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 529/1042] 10.222.0.41 () {58 vars in 1139 bytes} [Tue Dec 7 18:51:43 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 07 18:51:43.346003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cbbf1448-34a4-43c6-9d70-0bb462cc7b3c tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003633 Dec 07 18:51:43.346513 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 514/1043] 10.222.0.41 () {58 vars in 1136 bytes} [Tue Dec 7 18:51:43 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 07 18:51:43.355130 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bf6d01ea-ade1-46c6-8aca-c586019d58d6 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Calling method '.version_select at 0x7f198bfc3550>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:43.383268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-bf6d01ea-ade1-46c6-8aca-c586019d58d6 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] HTTP exception thrown: Volume d6174c3a-1225-4930-a23f-c99ec079d994 could not be found. Dec 07 18:51:43.383869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bf6d01ea-ade1-46c6-8aca-c586019d58d6 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Returning 404 to user: Volume d6174c3a-1225-4930-a23f-c99ec079d994 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:43.384735 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bf6d01ea-ade1-46c6-8aca-c586019d58d6 tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/d6174c3a-1225-4930-a23f-c99ec079d994" status: 404 len: 109 microversion: 2.1 time: 0.033257 Dec 07 18:51:43.385284 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 530/1044] 10.222.0.41 () {58 vars in 1247 bytes} [Tue Dec 7 18:51:43 2021] DELETE /compute/v2.1/os-volumes/d6174c3a-1225-4930-a23f-c99ec079d994 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 07 18:51:43.395799 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cc9c7d65-ba09-4a18-aae7-c8082ad274cd tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Calling method '.version_select at 0x7f1998103f70>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:43.425424 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-cc9c7d65-ba09-4a18-aae7-c8082ad274cd tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] HTTP exception thrown: Volume 100b4eaa-ac64-4dfa-b6ca-db1b5383b0e7 could not be found. Dec 07 18:51:43.426275 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cc9c7d65-ba09-4a18-aae7-c8082ad274cd tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] Returning 404 to user: Volume 100b4eaa-ac64-4dfa-b6ca-db1b5383b0e7 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:43.427277 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cc9c7d65-ba09-4a18-aae7-c8082ad274cd tempest-VolumesNegativeTest-1714496131 tempest-VolumesNegativeTest-1714496131-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/100b4eaa-ac64-4dfa-b6ca-db1b5383b0e7" status: 404 len: 109 microversion: 2.1 time: 0.035162 Dec 07 18:51:43.427980 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 515/1045] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:51:43 2021] GET /compute/v2.1/os-volumes/100b4eaa-ac64-4dfa-b6ca-db1b5383b0e7 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:51:43.718324 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:43.718939 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:43.725739 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:43.726470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:43.727258 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:43.727693 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:43.891967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:43.900424 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:43.902405 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:43.904797 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-1eae3106-b2b2-4fd6-8a17-3d1df62ad7b8 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.192086 Dec 07 18:51:43.905591 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 531/1046] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:43 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:44.148781 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:44.149443 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:44.158343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:44.158860 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:44.159779 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:44.160191 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:44.376099 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:44.383906 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a156f1a5-b653-4291-87d3-2e5f7f3c3ede tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.239182 Dec 07 18:51:44.384742 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 516/1047] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:44 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:51:44.923960 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:44.924751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:44.931031 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:44.931557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:44.932386 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:44.932882 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:45.071480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:45.079901 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:45.081491 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:45.082733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-053f7312-8bda-4725-aa2d-9f36a6f00720 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.162913 Dec 07 18:51:45.083288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 532/1048] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:44 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:45.403493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:45.404971 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:45.412496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:45.413171 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:45.414339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:45.415110 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:45.631573 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:45.640332 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-be6959e6-29f3-42a7-8c89-ada2f6bd0a28 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1569 microversion: 2.1 time: 0.241820 Dec 07 18:51:45.641435 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 517/1049] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:45 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:51:46.103786 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:46.104413 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:46.112218 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:46.112751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:46.113537 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:46.114004 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:46.245592 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:46.254399 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:46.256006 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:46.257165 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c43b4598-87d6-4273-ba68-489fefd155e2 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.158226 Dec 07 18:51:46.257728 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 533/1050] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:46 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:46.657180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:46.657735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:46.664251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:46.664710 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:46.665497 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:46.665957 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:46.800737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:46.808091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-58b95aba-f679-43f4-9bd8-ffd121bd1a91 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1450 microversion: 2.1 time: 0.155112 Dec 07 18:51:46.808667 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 518/1051] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:46 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:51:47.275416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:47.276025 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:47.282296 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:47.282744 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:47.283518 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:47.283955 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:47.477705 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-df05583f-b011-4723-90f9-a95e3bad89a9 req-38621918-ee24-440d-823b-5f4bddbfe339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6353ff89-98cf-4e56-b677-b0f9431d7e1d", "name": "network-vif-deleted", "tag": "ea0e7445-57e1-4ed8-b96b-ef483e19d0bd"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:47.479579 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:51:47.479579 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:51:47.487577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-df05583f-b011-4723-90f9-a95e3bad89a9 req-38621918-ee24-440d-823b-5f4bddbfe339 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:47.488009 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-df05583f-b011-4723-90f9-a95e3bad89a9 req-38621918-ee24-440d-823b-5f4bddbfe339 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:47.500327 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-df05583f-b011-4723-90f9-a95e3bad89a9 req-38621918-ee24-440d-823b-5f4bddbfe339 service nova] Creating event network-vif-deleted:ea0e7445-57e1-4ed8-b96b-ef483e19d0bd for instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d on hv-cinder-81969 Dec 07 18:51:47.505774 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-df05583f-b011-4723-90f9-a95e3bad89a9 req-38621918-ee24-440d-823b-5f4bddbfe339 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032101 Dec 07 18:51:47.506473 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 519/1052] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:51:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:47.697383 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:47.706758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:47.708267 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:47.709483 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f2151095-9162-4e97-a238-60953f7f0ed5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.437789 Dec 07 18:51:47.710061 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 534/1053] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:47 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:47.825785 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:47.826680 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:47.835190 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:47.835653 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:47.836850 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:47.837482 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:47.876340 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:47.876852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:47.877367 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lazy-loading 'fault' on Instance uuid 6353ff89-98cf-4e56-b677-b0f9431d7e1d {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:51:47.926464 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb48055ae8141bbb31e920aba3f6763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb7c47db4047b7b6b9fdc130ea461d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:47.937452 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-53390f0d-cfc1-453e-8022-fec58bce6091 tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 200 len: 1224 microversion: 2.1 time: 0.116230 Dec 07 18:51:47.938336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 520/1054] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:47 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:51:48.728042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:48.728653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:48.735194 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:48.735643 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:48.736419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:48.736854 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:48.863919 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:48.872219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:48.873836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:48.875015 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4a835023-3982-4a96-b7b9-955d81509361 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.150764 Dec 07 18:51:48.875585 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 535/1055] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:48 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:48.960006 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:48.960607 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] [instance: 6353ff89-98cf-4e56-b677-b0f9431d7e1d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:48.967074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:48.967519 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:48.968292 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:48.968718 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:48.981407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] HTTP exception thrown: Instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d could not be found. Dec 07 18:51:48.981813 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Returning 404 to user: Instance 6353ff89-98cf-4e56-b677-b0f9431d7e1d could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:51:48.982648 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8dc1bcba-5fb6-4b5f-8c88-aa64090bb85d tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d" status: 404 len: 111 microversion: 2.1 time: 0.026419 Dec 07 18:51:48.983168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 521/1056] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:51:48 2021] GET /compute/v2.1/servers/6353ff89-98cf-4e56-b677-b0f9431d7e1d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:51:49.137251 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ea41e937-3596-4850-861e-e6b4af7774cf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] Calling method '.version_select at 0x7f199801bd30>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:49.155284 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ea41e937-3596-4850-861e-e6b4af7774cf tempest-TestShelveInstance-1634793431 tempest-TestShelveInstance-1634793431-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1526245359" status: 202 len: 0 microversion: 2.1 time: 0.021689 Dec 07 18:51:49.155868 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 536/1057] 10.222.0.41 () {58 vars in 1253 bytes} [Tue Dec 7 18:51:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1526245359 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 18:51:49.892975 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:49.893581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:49.899736 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:49.900212 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:49.901409 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:49.902258 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:50.377343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:50.385231 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:50.386802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:50.388792 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d5dc77d4-103c-41b8-9f09-aeaa847543e6 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.499604 Dec 07 18:51:50.389344 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 522/1058] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:49 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:51:51.408863 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:51.410299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:51.422605 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:51.423288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:51.424485 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:51.430109 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:51.585479 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:51.594233 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:51.595931 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:51.597190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4e10d50f-1984-4945-bca3-b7832455d766 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.194258 Dec 07 18:51:51.597843 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 537/1059] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:51 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:52.348212 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-cbc41691-6a43-42dc-8801-563a9de032d4 req-3241cf28-312d-43b6-85e1-7fdfd01cf47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017abb4f-1da1-4373-83da-f4e5b0d2516b", "name": "network-vif-plugged", "status": "completed", "tag": "9d321fb6-c496-4034-a6c7-7c7410c908b0"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:51:52.349544 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:51:52.349544 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:51:52.359653 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-cbc41691-6a43-42dc-8801-563a9de032d4 req-3241cf28-312d-43b6-85e1-7fdfd01cf47c service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:52.360106 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-cbc41691-6a43-42dc-8801-563a9de032d4 req-3241cf28-312d-43b6-85e1-7fdfd01cf47c service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:52.376144 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-cbc41691-6a43-42dc-8801-563a9de032d4 req-3241cf28-312d-43b6-85e1-7fdfd01cf47c service nova] Creating event network-vif-plugged:9d321fb6-c496-4034-a6c7-7c7410c908b0 for instance 017abb4f-1da1-4373-83da-f4e5b0d2516b on hv-cinder-81969 Dec 07 18:51:52.381006 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-cbc41691-6a43-42dc-8801-563a9de032d4 req-3241cf28-312d-43b6-85e1-7fdfd01cf47c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037091 Dec 07 18:51:52.381754 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 523/1060] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:51:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:51:52.622835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:52.624188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:52.637775 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:52.643037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:52.645216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:52.645996 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:52.886781 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:52.895414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:52.897034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:52.898361 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-72a34251-c4ac-473f-ab3b-0ebba61369af tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.283303 Dec 07 18:51:52.909460 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 538/1061] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:52 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:53.921375 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:53.923084 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:53.935046 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:53.935627 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:53.936502 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:53.937008 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:54.206908 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:54.215384 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:54.216904 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:54.218083 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0e5aa239-9efe-459e-b31b-e93edd295959 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1733 microversion: 2.20 time: 0.304622 Dec 07 18:51:54.218896 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 524/1062] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:53 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1733 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:51:55.237223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:51:55.237792 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:51:55.245071 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:55.245538 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:55.246939 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:51:55.247376 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:51:55.410668 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:55.424920 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:55.431913 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:51:55.434949 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cfa58632-12f9-4fef-9b4a-a0290ce8663d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1720 microversion: 2.20 time: 0.201411 Dec 07 18:51:55.435666 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 539/1063] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:51:55 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:52:28.720773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-bff66324-5758-441f-ad35-bd94f48fe6d5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:28.721691 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-bff66324-5758-441f-ad35-bd94f48fe6d5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:28.727501 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bff66324-5758-441f-ad35-bd94f48fe6d5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:28.727956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bff66324-5758-441f-ad35-bd94f48fe6d5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:28.728737 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bff66324-5758-441f-ad35-bd94f48fe6d5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:28.729174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-bff66324-5758-441f-ad35-bd94f48fe6d5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:28.757330 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-bff66324-5758-441f-ad35-bd94f48fe6d5 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040542 Dec 07 18:52:28.758004 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 525/1064] 10.222.0.41 () {60 vars in 1342 bytes} [Tue Dec 7 18:52:28 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:28.814299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:28.814808 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:28.820769 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:28.821220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:28.822024 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:28.822464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:28.846283 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:52:28.924834 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f105d92d-8b4b-428e-806a-d7b557ee9680 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 204 len: 0 microversion: 2.20 time: 0.113844 Dec 07 18:52:28.925448 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 540/1065] 10.222.0.41 () {60 vars in 1279 bytes} [Tue Dec 7 18:52:28 2021] DELETE /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 07 18:52:28.933624 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:28.934370 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:28.940112 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:28.940550 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:28.941342 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:28.941765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:29.080389 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:29.088252 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:29.090056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:29.091254 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ae3537d0-71fb-4f50-92e9-56c7450a7915 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.161609 Dec 07 18:52:29.091849 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 526/1066] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:52:28 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:52:30.109188 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:30.110681 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:30.117535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:30.118011 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:30.118930 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:30.119363 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:30.275709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:30.284569 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:30.286191 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:30.287374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a6960794-6c22-4fd5-a041-716c4659ce40 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1726 microversion: 2.20 time: 0.182654 Dec 07 18:52:30.287984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 541/1067] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:52:30 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:52:31.109804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-97bc3cb1-5923-4b79-bbda-8886d4a1d13f req-714f4422-fcf8-460e-ae61-5c80f3b19cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017abb4f-1da1-4373-83da-f4e5b0d2516b", "name": "network-vif-deleted", "tag": "9d321fb6-c496-4034-a6c7-7c7410c908b0"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:52:31.112002 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:52:31.112002 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:52:31.122260 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-97bc3cb1-5923-4b79-bbda-8886d4a1d13f req-714f4422-fcf8-460e-ae61-5c80f3b19cb6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:31.122695 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-97bc3cb1-5923-4b79-bbda-8886d4a1d13f req-714f4422-fcf8-460e-ae61-5c80f3b19cb6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:31.133474 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-97bc3cb1-5923-4b79-bbda-8886d4a1d13f req-714f4422-fcf8-460e-ae61-5c80f3b19cb6 service nova] Creating event network-vif-deleted:9d321fb6-c496-4034-a6c7-7c7410c908b0 for instance 017abb4f-1da1-4373-83da-f4e5b0d2516b on hv-cinder-81969 Dec 07 18:52:31.138623 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-97bc3cb1-5923-4b79-bbda-8886d4a1d13f req-714f4422-fcf8-460e-ae61-5c80f3b19cb6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033386 Dec 07 18:52:31.139212 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 527/1068] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:52:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:52:31.306561 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:31.307174 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:31.313779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:31.314480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:31.315447 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:31.316034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:31.379717 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:31.388359 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:31.389887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:31.391057 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-32bc49bd-e357-46d2-9158-dfaaacd23ae7 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1367 microversion: 2.20 time: 0.088182 Dec 07 18:52:31.391621 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 542/1069] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:52:31 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 07 18:52:32.409942 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:32.410568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:32.417063 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:32.417506 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:32.418886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:32.419431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:32.479713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:32.488181 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:32.489663 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '70351b4675ab4d3690f6b5565dedd3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2417a4b6b8b04e738fe57f1c882d88bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:32.490793 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-76ad8adf-386d-475f-a281-0b4d768e3284 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 200 len: 1367 microversion: 2.20 time: 0.085077 Dec 07 18:52:32.491350 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 528/1070] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:52:32 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 1367 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 07 18:52:33.508967 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:33.509564 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:33.515981 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:33.516423 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:33.517192 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:33.517616 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:33.530852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] HTTP exception thrown: Instance 017abb4f-1da1-4373-83da-f4e5b0d2516b could not be found. Dec 07 18:52:33.531359 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Returning 404 to user: Instance 017abb4f-1da1-4373-83da-f4e5b0d2516b could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:52:33.532161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-960c8bab-267c-4ea5-9d9c-0161d902805d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 404 len: 111 microversion: 2.20 time: 0.026989 Dec 07 18:52:33.532686 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 543/1071] 10.222.0.41 () {60 vars in 1276 bytes} [Tue Dec 7 18:52:33 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 07 18:52:33.540742 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0fe01bfb-c3d7-479b-8449-107b017e9e83 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '.version_select at 0x7f1998103040>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:33.558742 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0fe01bfb-c3d7-479b-8449-107b017e9e83 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054595563" status: 204 len: 0 microversion: 2.20 time: 0.021580 Dec 07 18:52:33.559303 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 529/1072] 10.222.0.41 () {60 vars in 1261 bytes} [Tue Dec 7 18:52:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1054595563 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 07 18:52:37.405818 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:37.406345 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:37.412495 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:37.412943 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:37.413714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:37.414167 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:37.430235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] HTTP exception thrown: Instance 017abb4f-1da1-4373-83da-f4e5b0d2516b could not be found. Dec 07 18:52:37.430817 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Returning 404 to user: Instance 017abb4f-1da1-4373-83da-f4e5b0d2516b could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:52:37.432105 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-00c929c6-9847-4472-a260-22e8befdb7a0 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 404 len: 111 microversion: 2.1 time: 0.030480 Dec 07 18:52:37.432206 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 544/1073] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:52:37 2021] DELETE /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:52:37.439937 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:37.440547 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: 017abb4f-1da1-4373-83da-f4e5b0d2516b] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:37.447343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:37.447796 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:37.448564 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:37.448999 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:37.461452 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] HTTP exception thrown: Instance 017abb4f-1da1-4373-83da-f4e5b0d2516b could not be found. Dec 07 18:52:37.462053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Returning 404 to user: Instance 017abb4f-1da1-4373-83da-f4e5b0d2516b could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:52:37.462857 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-2bc8b7be-30ae-49b9-9bf2-a1335dfed99d tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b" status: 404 len: 111 microversion: 2.1 time: 0.026594 Dec 07 18:52:37.463373 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 530/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:37 2021] GET /compute/v2.1/servers/017abb4f-1da1-4373-83da-f4e5b0d2516b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:52:38.592900 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:38.593399 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:38.599673 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:38.600125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:38.600898 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:38.601334 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:38.614259 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] HTTP exception thrown: Instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c could not be found. Dec 07 18:52:38.614836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Returning 404 to user: Instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:52:38.615647 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-eccb6f58-623e-442e-9581-ed3707ad8e95 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "DELETE /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 404 len: 111 microversion: 2.1 time: 0.027190 Dec 07 18:52:38.616166 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 545/1075] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:52:38 2021] DELETE /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:52:38.626130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:38.627222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] [instance: a54d910a-30a1-4aa9-a038-6dafd95bfa5c] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:38.634087 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:38.634605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:38.635476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:38.635980 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:38.651178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] HTTP exception thrown: Instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c could not be found. Dec 07 18:52:38.651756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] Returning 404 to user: Instance a54d910a-30a1-4aa9-a038-6dafd95bfa5c could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:52:38.652563 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ae4797ff-d6ca-40fd-8cd5-e2707f179554 tempest-AttachVolumeShelveTestJSON-983737646 tempest-AttachVolumeShelveTestJSON-983737646-project] 10.222.0.41 "GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c" status: 404 len: 111 microversion: 2.1 time: 0.032308 Dec 07 18:52:38.653096 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 531/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:38 2021] GET /compute/v2.1/servers/a54d910a-30a1-4aa9-a038-6dafd95bfa5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:52:44.457876 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4f363305-2e91-44a1-ac28-fb970b95c706 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f1998080310>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:44.507304 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4f363305-2e91-44a1-ac28-fb970b95c706 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/da161e8a-54eb-4b97-ac23-d450590432dd" status: 200 len: 351 microversion: 2.1 time: 0.053091 Dec 07 18:52:44.507864 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 546/1077] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:52:44 2021] GET /compute/v2.1/os-volumes/da161e8a-54eb-4b97-ac23-d450590432dd => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:52:45.741461 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b4908101-2737-491e-b077-31e6c36e30fa tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f19980d7b80>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:45.799035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b4908101-2737-491e-b077-31e6c36e30fa tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0193a981-09b6-48bf-b9e5-ffb69fcd3d03" status: 200 len: 350 microversion: 2.1 time: 0.055121 Dec 07 18:52:45.799035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 532/1078] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:52:45 2021] GET /compute/v2.1/os-volumes/0193a981-09b6-48bf-b9e5-ffb69fcd3d03 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:52:47.020669 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f531ca72-52da-4f4f-b2de-b1043623db33 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f198bfd9160>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.068645 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f531ca72-52da-4f4f-b2de-b1043623db33 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/dbc53b1c-1a4d-4644-a20f-12a46fd6b4ee" status: 200 len: 351 microversion: 2.1 time: 0.052035 Dec 07 18:52:47.069317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 547/1079] 10.222.0.41 () {58 vars in 1244 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes/dbc53b1c-1a4d-4644-a20f-12a46fd6b4ee => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:52:47.081594 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-348d24a5-1cd3-4ccb-a912-627a22e8479d tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f1998103af0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.159968 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-348d24a5-1cd3-4ccb-a912-627a22e8479d tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082840 Dec 07 18:52:47.160666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 533/1080] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:52:47.172737 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-62715cf8-de79-46a8-be23-0a1413358235 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f198bf53700>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.252404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-62715cf8-de79-46a8-be23-0a1413358235 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083631 Dec 07 18:52:47.253090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 548/1081] 10.222.0.41 () {58 vars in 1148 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:52:47.264604 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f828ad62-474c-4ba2-a25f-1af0eb0e1eb7 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f19980f2dc0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.346510 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f828ad62-474c-4ba2-a25f-1af0eb0e1eb7 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085386 Dec 07 18:52:47.347078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 534/1082] 10.222.0.41 () {58 vars in 1133 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:47.358006 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-6fc235b2-9664-4c70-a812-5690f69bb1e7 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f198bf0b670>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.438907 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-6fc235b2-9664-4c70-a812-5690f69bb1e7 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084544 Dec 07 18:52:47.439473 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 549/1083] 10.222.0.41 () {58 vars in 1166 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:52:47.450807 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8f5fa2f2-c2d8-4125-869c-208d4b6b5c59 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f1998092790>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.531130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8f5fa2f2-c2d8-4125-869c-208d4b6b5c59 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083783 Dec 07 18:52:47.531947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 535/1084] 10.222.0.41 () {58 vars in 1169 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:52:47.543709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8dadba73-da4c-486d-ba56-9058dba43ef8 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f198bf531f0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.627753 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8dadba73-da4c-486d-ba56-9058dba43ef8 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085748 Dec 07 18:52:47.627753 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 550/1085] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:47.637003 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a6d77f9f-417c-4a08-8f08-1a3676869026 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f19980f25e0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.715700 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a6d77f9f-417c-4a08-8f08-1a3676869026 tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082141 Dec 07 18:52:47.716460 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 536/1086] 10.222.0.41 () {58 vars in 1187 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:52:47.727689 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9acf6e54-3356-4ddc-9c1c-04ebc1cbf81d tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] Calling method '.version_select at 0x7f198bfacca0>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:47.809070 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9acf6e54-3356-4ddc-9c1c-04ebc1cbf81d tempest-VolumesTestJSON-1844509423 tempest-VolumesTestJSON-1844509423-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084905 Dec 07 18:52:47.810229 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 551/1087] 10.222.0.41 () {58 vars in 1154 bytes} [Tue Dec 7 18:52:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:50.305420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-562585137", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "b0e81c76-331e-4631-8859-b9be0335d391"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:52:50.360778 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] validate_networks() for [('b0e81c76-331e-4631-8859-b9be0335d391', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:52:50.698820 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:52:50.699271 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:52:50.699770 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:52:50.700178 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:52:50.701177 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:52:50.709613 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:50.710095 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:50.710904 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:50.711339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:50.727934 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Getting quotas for project ab4a4662276147e9b7c0c7996bf05dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:52:50.731954 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Getting quotas for user aa758b1ae8a24f17aa3f6b8441348b35 and project ab4a4662276147e9b7c0c7996bf05dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:52:50.742342 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:52:50.744574 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:52:50.785590 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [e28a57cb-8153-4e30-83c4-31a1b753220c] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 07 18:52:51.802436 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [e28a57cb-8153-4e30-83c4-31a1b753220c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 34628. Dec 07 18:52:51.806244 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-186761ef-286b-4de0-8454-0a833b973839 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504966 Dec 07 18:52:51.807365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 537/1088] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:52:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:52:51.818181 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0c918252-39a9-413b-bfc9-24b0e7b67091 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:51.818811 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0c918252-39a9-413b-bfc9-24b0e7b67091 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:51.870095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0c918252-39a9-413b-bfc9-24b0e7b67091 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:51.877222 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0c918252-39a9-413b-bfc9-24b0e7b67091 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1213 microversion: 2.1 time: 0.063363 Dec 07 18:52:51.877788 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 552/1089] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:51 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:52:52.894808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1d36d37a-c730-443d-af82-e85eb5e6ea9d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:52.895424 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1d36d37a-c730-443d-af82-e85eb5e6ea9d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:52.947498 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1d36d37a-c730-443d-af82-e85eb5e6ea9d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:52.954512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1d36d37a-c730-443d-af82-e85eb5e6ea9d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1213 microversion: 2.1 time: 0.063406 Dec 07 18:52:52.955086 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 538/1090] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:52 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:53.971953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-453aa0f3-7619-446d-bc17-ba0b3a83af5d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:53.972567 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-453aa0f3-7619-446d-bc17-ba0b3a83af5d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:54.024610 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-453aa0f3-7619-446d-bc17-ba0b3a83af5d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:54.031836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-453aa0f3-7619-446d-bc17-ba0b3a83af5d tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1213 microversion: 2.1 time: 0.063601 Dec 07 18:52:54.032401 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 553/1091] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:53 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:55.048799 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a9338a6e-a716-4b1f-95a1-36174f6b13e9 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:55.049407 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a9338a6e-a716-4b1f-95a1-36174f6b13e9 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:55.100382 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a9338a6e-a716-4b1f-95a1-36174f6b13e9 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:55.107679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a9338a6e-a716-4b1f-95a1-36174f6b13e9 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1213 microversion: 2.1 time: 0.062121 Dec 07 18:52:55.108441 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 539/1092] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:55 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:52:56.125202 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:56.125733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:56.132019 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:56.132467 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:56.133235 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:56.133667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:56.193629 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:56.201408 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f32cb9d5-717b-4672-8f00-5ae4826d8abe tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1217 microversion: 2.1 time: 0.080671 Dec 07 18:52:56.202010 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 554/1093] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:56 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:57.219470 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:57.220068 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:57.226859 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:57.227301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:57.228062 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:57.228492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:57.285813 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:57.292878 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b39d96b3-a50d-4b55-b154-157d078c9b2e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1217 microversion: 2.1 time: 0.078546 Dec 07 18:52:57.293426 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 540/1094] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:57 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:58.311667 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:58.312185 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:58.318449 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:58.318899 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:58.319665 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:58.320096 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:58.380539 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:58.387639 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-351e201c-05a0-439c-b2b5-52d80ddeeb75 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1209 microversion: 2.1 time: 0.080855 Dec 07 18:52:58.388201 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 555/1095] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:58 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:52:59.406232 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:52:59.406685 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:52:59.413411 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:59.413957 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:59.414802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:52:59.415319 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:52:59.492320 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:52:59.500078 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d420fa21-6e7e-43b3-90b7-0b8eaa141578 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1271 microversion: 2.1 time: 0.098587 Dec 07 18:52:59.500655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 541/1096] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:52:59 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:00.346617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-cc2a0289-4554-45a9-98f1-89c7cbc0d542 req-76873d80-e0aa-4452-80a0-874306934f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50941a59-fd90-4713-a406-45e9be8c6690", "tag": "76a9f558-907f-448f-9024-aa2905510277"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:53:00.349055 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:53:00.349055 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:53:00.358416 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-cc2a0289-4554-45a9-98f1-89c7cbc0d542 req-76873d80-e0aa-4452-80a0-874306934f61 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:00.359555 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-cc2a0289-4554-45a9-98f1-89c7cbc0d542 req-76873d80-e0aa-4452-80a0-874306934f61 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:00.376466 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-cc2a0289-4554-45a9-98f1-89c7cbc0d542 req-76873d80-e0aa-4452-80a0-874306934f61 service nova] Creating event network-changed:76a9f558-907f-448f-9024-aa2905510277 for instance 50941a59-fd90-4713-a406-45e9be8c6690 on hv-cinder-81969 Dec 07 18:53:00.381544 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-cc2a0289-4554-45a9-98f1-89c7cbc0d542 req-76873d80-e0aa-4452-80a0-874306934f61 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039672 Dec 07 18:53:00.382175 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 556/1097] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:53:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:53:00.520049 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:00.520812 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:00.531876 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:00.532623 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:00.533435 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:00.533874 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:00.781903 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:00.790173 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1cfef1a5-b330-4034-93d1-793e854b1472 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1313 microversion: 2.1 time: 0.273627 Dec 07 18:53:00.791039 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 542/1098] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:00 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:01.807636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:01.808330 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:01.815205 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:01.815652 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:01.816430 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:01.816862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:01.954593 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:01.961705 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f83949c6-d0b0-4f4d-85a5-d26d75050945 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1313 microversion: 2.1 time: 0.158109 Dec 07 18:53:01.962345 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 557/1099] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:01 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:02.977843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:02.978612 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:02.985592 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:02.986068 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:02.986843 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:02.987281 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:03.119220 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:03.127146 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-df9dd463-05c3-4edb-96ca-c39f84253565 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1313 microversion: 2.1 time: 0.153046 Dec 07 18:53:03.127715 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 543/1100] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:02 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:04.144116 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:04.144723 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:04.150688 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:04.154333 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:04.154333 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:04.154333 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:04.284353 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:04.291772 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2ea98c17-e742-4f8c-9636-6c2c57c685c2 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1313 microversion: 2.1 time: 0.151357 Dec 07 18:53:04.292340 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 558/1101] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:04 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:05.309081 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:05.309679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:05.317329 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:05.317735 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:05.318607 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:05.319047 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:05.446533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-af56debd-7020-4d52-b74b-6bd1d5eea0af req-657fec5c-6e3e-4f5a-8c80-2246e92f0a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50941a59-fd90-4713-a406-45e9be8c6690", "name": "network-vif-plugged", "status": "completed", "tag": "76a9f558-907f-448f-9024-aa2905510277"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:53:05.448979 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:53:05.448979 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:53:05.456601 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:05.458786 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-af56debd-7020-4d52-b74b-6bd1d5eea0af req-657fec5c-6e3e-4f5a-8c80-2246e92f0a84 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:05.459587 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-af56debd-7020-4d52-b74b-6bd1d5eea0af req-657fec5c-6e3e-4f5a-8c80-2246e92f0a84 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:05.463802 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f26364de-ddb5-4544-b602-ff1f53e4fedb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1313 microversion: 2.1 time: 0.158428 Dec 07 18:53:05.464378 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 544/1102] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:05 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:05.471404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-af56debd-7020-4d52-b74b-6bd1d5eea0af req-657fec5c-6e3e-4f5a-8c80-2246e92f0a84 service nova] Creating event network-vif-plugged:76a9f558-907f-448f-9024-aa2905510277 for instance 50941a59-fd90-4713-a406-45e9be8c6690 on hv-cinder-81969 Dec 07 18:53:05.476464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-af56debd-7020-4d52-b74b-6bd1d5eea0af req-657fec5c-6e3e-4f5a-8c80-2246e92f0a84 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034309 Dec 07 18:53:05.477136 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 559/1103] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:53:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:53:06.480794 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:06.481394 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:06.488821 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:06.489266 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:06.490062 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:06.490494 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:06.625723 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:06.633765 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-54eab3f3-3acd-458e-a2a1-f9f74586abc4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1313 microversion: 2.1 time: 0.156539 Dec 07 18:53:06.634369 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 545/1104] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:06 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:07.651506 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:07.652208 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:07.658801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:07.659249 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:07.660028 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:07.660458 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:07.852565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:07.861497 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-a7f31c56-1076-4329-873d-fc84115879a8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1498 microversion: 2.1 time: 0.214454 Dec 07 18:53:07.862095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 560/1105] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:07 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:08.237950 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:08.239035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:08.245103 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:08.245551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:08.246347 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:08.246785 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:08.271351 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:53:08.347661 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b1e0439a-a68a-4eaa-8f41-35bda2019a4e tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "DELETE /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 204 len: 0 microversion: 2.1 time: 0.112964 Dec 07 18:53:08.348274 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 546/1106] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:53:08 2021] DELETE /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:53:08.356264 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:08.356887 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:08.362725 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:08.363802 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:08.364589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:08.365022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:08.506217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:08.513588 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-9ef434ed-156b-4d5b-8875-5fa94ac2277f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1504 microversion: 2.1 time: 0.160960 Dec 07 18:53:08.514190 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 561/1107] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:08 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:53:09.531941 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:09.532556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:09.538678 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:09.539127 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:09.539907 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:09.540329 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:09.673020 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:09.680420 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5153c03a-5b5b-4756-983e-325240e42e46 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 200 len: 1504 microversion: 2.1 time: 0.153534 Dec 07 18:53:09.680998 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 547/1108] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:09 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:10.149743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-b67cf223-9983-4d04-98d6-38ca0ba336f3 req-52fd424c-6de4-45e5-87e1-ed2c97bac891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50941a59-fd90-4713-a406-45e9be8c6690", "name": "network-vif-deleted", "tag": "76a9f558-907f-448f-9024-aa2905510277"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:53:10.151896 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:53:10.151896 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:53:10.161581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b67cf223-9983-4d04-98d6-38ca0ba336f3 req-52fd424c-6de4-45e5-87e1-ed2c97bac891 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:10.162043 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-b67cf223-9983-4d04-98d6-38ca0ba336f3 req-52fd424c-6de4-45e5-87e1-ed2c97bac891 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:10.177117 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-b67cf223-9983-4d04-98d6-38ca0ba336f3 req-52fd424c-6de4-45e5-87e1-ed2c97bac891 service nova] Creating event network-vif-deleted:76a9f558-907f-448f-9024-aa2905510277 for instance 50941a59-fd90-4713-a406-45e9be8c6690 on hv-cinder-81969 Dec 07 18:53:10.184317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-b67cf223-9983-4d04-98d6-38ca0ba336f3 req-52fd424c-6de4-45e5-87e1-ed2c97bac891 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038914 Dec 07 18:53:10.185945 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 562/1109] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:53:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:53:10.700764 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:10.702300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 50941a59-fd90-4713-a406-45e9be8c6690] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:10.709816 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:10.710339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:10.711238 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:10.712218 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:10.727385 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] HTTP exception thrown: Instance 50941a59-fd90-4713-a406-45e9be8c6690 could not be found. Dec 07 18:53:10.727989 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Returning 404 to user: Instance 50941a59-fd90-4713-a406-45e9be8c6690 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:53:10.729191 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-30e719dd-c04a-41e4-bb67-31d95f78f9bb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690" status: 404 len: 111 microversion: 2.1 time: 0.032282 Dec 07 18:53:10.729979 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 548/1110] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:10 2021] GET /compute/v2.1/servers/50941a59-fd90-4713-a406-45e9be8c6690 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:53:10.830867 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-669006539", "imageRef": "cf6ed547-8e8e-41c0-bd41-f559300ac3e6", "flavorRef": "452", "networks": [{"uuid": "b0e81c76-331e-4631-8859-b9be0335d391"}]}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:53:10.882414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] validate_networks() for [('b0e81c76-331e-4631-8859-b9be0335d391', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:53:11.228727 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:53:11.229310 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:53:11.229599 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:53:11.230040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:53:11.230451 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:53:11.239638 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:11.240081 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:11.240879 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:11.241311 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:11.257519 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Getting quotas for project ab4a4662276147e9b7c0c7996bf05dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:53:11.261374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Getting quotas for user aa758b1ae8a24f17aa3f6b8441348b35 and project ab4a4662276147e9b7c0c7996bf05dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:53:11.274083 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:53:11.276550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf6ed547-8e8e-41c0-bd41-f559300ac3e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:53:11.319704 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-98e29394-c026-4109-9015-f8898de35b35 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493556 Dec 07 18:53:11.320346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 563/1111] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:53:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:53:11.330920 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-f66c8563-5ee1-4f18-96de-2f0cab6244c0 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:11.331533 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-f66c8563-5ee1-4f18-96de-2f0cab6244c0 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:11.382495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-f66c8563-5ee1-4f18-96de-2f0cab6244c0 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:11.389720 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-f66c8563-5ee1-4f18-96de-2f0cab6244c0 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1213 microversion: 2.1 time: 0.062385 Dec 07 18:53:11.390392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 549/1112] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:11 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:12.408664 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:12.409310 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:12.421361 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:12.421828 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:12.422715 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:12.423226 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:12.490551 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:12.498056 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-2860dbd0-71b5-42d8-9adc-0cd0607f130f tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1271 microversion: 2.1 time: 0.094429 Dec 07 18:53:12.498589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 564/1113] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:12 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:13.515777 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:13.516393 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:13.523262 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:13.523712 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:13.524489 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:13.524915 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:13.734546 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:13.744709 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-97172521-c7bd-471e-99ce-6c6722cedc84 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.231921 Dec 07 18:53:13.745428 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 550/1114] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:13 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:13.840624 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-0524f1b9-de86-4fa8-b7dc-1e94ba5c0ec6 req-101d0d73-5269-40d8-9698-5b9ad5e099a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394299fb-bc7e-4509-8940-507377ed94b5", "tag": "1a023e36-76e2-4d0c-99d9-32c81d548124"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:53:13.844088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:53:13.844088 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:53:13.853164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-0524f1b9-de86-4fa8-b7dc-1e94ba5c0ec6 req-101d0d73-5269-40d8-9698-5b9ad5e099a6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:13.853292 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-0524f1b9-de86-4fa8-b7dc-1e94ba5c0ec6 req-101d0d73-5269-40d8-9698-5b9ad5e099a6 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:13.872650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-0524f1b9-de86-4fa8-b7dc-1e94ba5c0ec6 req-101d0d73-5269-40d8-9698-5b9ad5e099a6 service nova] Creating event network-changed:1a023e36-76e2-4d0c-99d9-32c81d548124 for instance 394299fb-bc7e-4509-8940-507377ed94b5 on hv-cinder-81969 Dec 07 18:53:13.878095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-0524f1b9-de86-4fa8-b7dc-1e94ba5c0ec6 req-101d0d73-5269-40d8-9698-5b9ad5e099a6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040683 Dec 07 18:53:13.878700 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 565/1115] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:53:14.761822 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:14.762462 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:14.770021 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:14.770531 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:14.771562 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:14.771999 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:14.908918 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:14.916222 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8716e0f4-1abb-4ce9-83e2-0bc5ebcbebfd tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.158156 Dec 07 18:53:14.917170 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 551/1116] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:14 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:15.934571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:15.935317 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:15.941822 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:15.942338 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:15.943132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:15.943557 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:16.079956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:16.087261 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-c6235ba3-dd16-433f-b0eb-3a6cbbf56f70 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.157331 Dec 07 18:53:16.087842 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 566/1117] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:15 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:17.104442 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:17.105071 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:17.111575 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:17.112026 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:17.112894 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:17.113339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:17.303167 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:17.311488 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6c491a21-f9e9-4842-8982-29b1ed2edfaf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.210749 Dec 07 18:53:17.312102 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 552/1118] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:17 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:53:18.328946 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:18.329560 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:18.336273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:18.336680 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:18.337473 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:18.337930 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:18.478547 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:18.485623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-69ae3042-5d22-4863-81ba-02a35b6dbeef tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.161043 Dec 07 18:53:18.486219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 567/1119] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:18 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:19.491301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-be173856-75da-44b0-b3f0-95e669c59f49 req-24a4c5a0-6444-434c-ab2f-f349a68c9f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394299fb-bc7e-4509-8940-507377ed94b5", "name": "network-vif-plugged", "status": "completed", "tag": "1a023e36-76e2-4d0c-99d9-32c81d548124"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:53:19.492916 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:53:19.492916 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:53:19.500956 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-be173856-75da-44b0-b3f0-95e669c59f49 req-24a4c5a0-6444-434c-ab2f-f349a68c9f91 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:19.501119 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-be173856-75da-44b0-b3f0-95e669c59f49 req-24a4c5a0-6444-434c-ab2f-f349a68c9f91 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:19.509938 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:19.512216 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:19.518615 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:19.519151 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:19.520174 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:19.520607 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:19.521317 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-be173856-75da-44b0-b3f0-95e669c59f49 req-24a4c5a0-6444-434c-ab2f-f349a68c9f91 service nova] Creating event network-vif-plugged:1a023e36-76e2-4d0c-99d9-32c81d548124 for instance 394299fb-bc7e-4509-8940-507377ed94b5 on hv-cinder-81969 Dec 07 18:53:19.527869 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-be173856-75da-44b0-b3f0-95e669c59f49 req-24a4c5a0-6444-434c-ab2f-f349a68c9f91 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040208 Dec 07 18:53:19.528453 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 553/1120] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:53:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:53:19.661178 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:19.668393 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fe2fa321-2198-4f51-86c6-f94f7667b509 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.169177 Dec 07 18:53:19.668968 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 568/1121] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:19 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:53:20.687056 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:20.687664 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:20.693679 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:20.694158 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:20.694926 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:20.695356 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:20.824633 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:20.832318 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-306d9190-4cfb-484d-a774-0b2dfa4a538a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.149834 Dec 07 18:53:20.832885 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 554/1122] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:20 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:21.849567 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:21.850200 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:21.856407 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:21.857481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:21.858282 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:21.858712 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:21.992669 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:22.000026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-4a099828-8a06-41a3-b14a-1f3deb4315e4 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.154167 Dec 07 18:53:22.000581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 569/1123] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:21 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:23.016908 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:23.017509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:23.023908 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:23.024343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:23.025280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:23.025709 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:23.164287 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:23.171906 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-896f71fc-8abb-4bd8-acea-fdaa2f444792 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1313 microversion: 2.1 time: 0.159374 Dec 07 18:53:23.172468 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 555/1124] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:23 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:24.188744 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:24.189380 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:24.195684 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:24.196132 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:24.196905 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:24.197337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:24.326982 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:24.334008 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-3f086896-c80e-49f9-bf45-190945a3b08a tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1497 microversion: 2.1 time: 0.149654 Dec 07 18:53:24.334565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 570/1125] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:24 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:24.727174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:24.727673 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:24.735246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:24.735697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:24.736475 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:24.736906 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:24.767450 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Going to try to terminate instance {{(pid=122586) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:53:24.843693 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-0979eb0e-a7e2-4c44-81e4-2806b337d3db tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "DELETE /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 204 len: 0 microversion: 2.1 time: 0.119950 Dec 07 18:53:24.844273 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 556/1126] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:53:24 2021] DELETE /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:53:24.852417 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:24.853022 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:24.859064 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:24.859534 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:24.860310 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:24.860711 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:24.993509 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:25.001869 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ecfc90bd-63eb-4dc7-83b7-7a5da2f5dcd8 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1503 microversion: 2.1 time: 0.153244 Dec 07 18:53:25.002459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 571/1127] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:24 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:26.019672 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:26.020384 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:26.026702 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:26.027289 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:26.028058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:26.028490 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:26.163392 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:26.174707 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3d09c2f8-2b36-4a2c-ae64-900f731d4935 tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1503 microversion: 2.1 time: 0.158880 Dec 07 18:53:26.175376 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 557/1128] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:26 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:26.770801 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-1b154869-d991-4464-8b02-4abdbab8b327 req-718050fd-deb3-4bc4-8f31-df8748e2df01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394299fb-bc7e-4509-8940-507377ed94b5", "name": "network-vif-deleted", "tag": "1a023e36-76e2-4d0c-99d9-32c81d548124"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:53:26.773695 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:53:26.773695 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:53:26.784349 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-1b154869-d991-4464-8b02-4abdbab8b327 req-718050fd-deb3-4bc4-8f31-df8748e2df01 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:26.784902 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-1b154869-d991-4464-8b02-4abdbab8b327 req-718050fd-deb3-4bc4-8f31-df8748e2df01 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:26.798301 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-1b154869-d991-4464-8b02-4abdbab8b327 req-718050fd-deb3-4bc4-8f31-df8748e2df01 service nova] Creating event network-vif-deleted:1a023e36-76e2-4d0c-99d9-32c81d548124 for instance 394299fb-bc7e-4509-8940-507377ed94b5 on hv-cinder-81969 Dec 07 18:53:26.804560 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-1b154869-d991-4464-8b02-4abdbab8b327 req-718050fd-deb3-4bc4-8f31-df8748e2df01 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037601 Dec 07 18:53:26.805288 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 572/1129] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:53:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:53:27.192536 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:27.193269 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:27.199940 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:27.201050 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:27.202119 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:27.202550 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:27.237199 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:27.237640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:27.238116 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.objects.instance [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lazy-loading 'fault' on Instance uuid 394299fb-bc7e-4509-8940-507377ed94b5 {{(pid=122586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 18:53:27.279929 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa758b1ae8a24f17aa3f6b8441348b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab4a4662276147e9b7c0c7996bf05dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:53:27.286520 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5e345fed-c27d-4932-8358-2004ad112abb tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 200 len: 1303 microversion: 2.1 time: 0.097671 Dec 07 18:53:27.287073 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 558/1130] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:27 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:53:28.305105 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:53:28.305803 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] [instance: 394299fb-bc7e-4509-8940-507377ed94b5] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:53:28.312390 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:28.312839 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:28.313630 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:53:28.314111 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:53:28.327569 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] HTTP exception thrown: Instance 394299fb-bc7e-4509-8940-507377ed94b5 could not be found. Dec 07 18:53:28.328139 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] Returning 404 to user: Instance 394299fb-bc7e-4509-8940-507377ed94b5 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:53:28.328945 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-65f107d5-b4c9-4e7f-80ba-36eeea7e20bf tempest-VolumesActionsTest-1895037552 tempest-VolumesActionsTest-1895037552-project] 10.222.0.41 "GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5" status: 404 len: 111 microversion: 2.1 time: 0.027952 Dec 07 18:53:28.329467 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 573/1131] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:53:28 2021] GET /compute/v2.1/servers/394299fb-bc7e-4509-8940-507377ed94b5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:54:07.041271 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 18:54:07.042146 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: Tue Dec 7 18:54:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 18:54:35.933493 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8d249c1d-fd20-4238-87cf-9841b0e166eb tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Action: 'create', calling method: .version_select at 0x7f19980fd5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-364844730"}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:54:35.947501 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-8d249c1d-fd20-4238-87cf-9841b0e166eb tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:54:35.951449 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-8d249c1d-fd20-4238-87cf-9841b0e166eb tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for user c402e3d5fad748379724a748609a04b5 and project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:54:36.222734 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-8d249c1d-fd20-4238-87cf-9841b0e166eb tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:54:36.226580 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-8d249c1d-fd20-4238-87cf-9841b0e166eb tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for user c402e3d5fad748379724a748609a04b5 and project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'key_pairs'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:54:36.239994 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8d249c1d-fd20-4238-87cf-9841b0e166eb tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.482463 Dec 07 18:54:36.240642 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 559/1132] 10.222.0.41 () {60 vars in 1157 bytes} [Tue Dec 7 18:54:35 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:54:52.275114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1788981334", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-364844730", "security_groups": [{"name": "tempest-secgroup-smoke-1705206457"}], "block_device_mapping_v2": [{"uuid": "b9ba3c4d-0fea-490c-b4a1-c2c0c443e305", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3e28be2-bcfa-4afd-ab13-222c89764d73"}]}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:54:52.483874 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] validate_networks() for [('c3e28be2-bcfa-4afd-ab13-222c89764d73', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:54:52.950463 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:54:52.950897 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:54:52.951360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:54:52.951759 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:54:52.952166 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:54:52.961498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:52.961953 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:52.962756 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:52.963187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:52.979841 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:54:52.983706 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for user c402e3d5fad748379724a748609a04b5 and project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:54:53.036826 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:54:53.039653 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9ba3c4d-0fea-490c-b4a1-c2c0c443e305',volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:54:53.161164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-45b874cd-c71e-4190-8636-682003c2a19a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891053 Dec 07 18:54:53.161798 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 574/1133] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:54:52 2021] POST /compute/v2.1/servers => generated 406 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:54:53.172946 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-7c26f68a-0435-4146-a2fd-c18760f6cc18 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:54:53.173548 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-7c26f68a-0435-4146-a2fd-c18760f6cc18 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:54:53.278478 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-7c26f68a-0435-4146-a2fd-c18760f6cc18 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:54:53.285852 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-7c26f68a-0435-4146-a2fd-c18760f6cc18 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1094 microversion: 2.1 time: 0.117455 Dec 07 18:54:53.286424 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 560/1134] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:54:53 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:54:54.305545 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:54:54.306179 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:54:54.312589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:54.313030 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:54.313806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:54.314260 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:54.389268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:54:54.399145 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-87ef40d5-5d09-4862-9dfe-14cc71196067 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1210 microversion: 2.1 time: 0.098436 Dec 07 18:54:54.400027 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 575/1135] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:54:54 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:54:55.419577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:54:55.420189 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:54:55.429655 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:55.430409 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:55.431419 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:55.432030 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:55.680155 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:54:55.684034 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-154d288f-c904-42df-8ff9-8de27a42e118 req-5c1f9ecb-4f64-4c7a-9e3a-bea6835a51d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3fd07c-6bd1-4f65-8941-503b928649a7", "tag": "f1869558-05b2-4ac8-8e27-f283cb7d365f"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:54:55.688751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:54:55.688751 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:54:55.691251 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-95eabe5c-3c0b-4c55-90b6-d53bb745a43f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.276053 Dec 07 18:54:55.697292 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-154d288f-c904-42df-8ff9-8de27a42e118 req-5c1f9ecb-4f64-4c7a-9e3a-bea6835a51d3 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:55.698026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-154d288f-c904-42df-8ff9-8de27a42e118 req-5c1f9ecb-4f64-4c7a-9e3a-bea6835a51d3 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:55.701795 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 561/1136] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:54:55 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:54:55.712006 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-154d288f-c904-42df-8ff9-8de27a42e118 req-5c1f9ecb-4f64-4c7a-9e3a-bea6835a51d3 service nova] Creating event network-changed:f1869558-05b2-4ac8-8e27-f283cb7d365f for instance ad3fd07c-6bd1-4f65-8941-503b928649a7 on hv-cinder-81969 Dec 07 18:54:55.717823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-154d288f-c904-42df-8ff9-8de27a42e118 req-5c1f9ecb-4f64-4c7a-9e3a-bea6835a51d3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130274 Dec 07 18:54:55.718639 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 576/1137] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:54:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:54:56.707589 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:54:56.708186 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:54:56.714676 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:56.715117 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:56.715873 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:56.716301 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:56.849706 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:54:56.857336 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-236d16be-fb37-4102-8daf-2c8a02a38976 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.153407 Dec 07 18:54:56.857892 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 562/1138] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:54:56 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:54:57.875185 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:54:57.875881 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:54:57.882538 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:57.882984 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:57.883746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:57.884175 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:58.017835 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:54:58.025082 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ee37d716-3c4a-4323-9a28-8529e32dc025 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.154380 Dec 07 18:54:58.025640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 577/1139] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:54:57 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:54:59.041756 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:54:59.042383 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:54:59.048790 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:59.049228 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:59.050019 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:54:59.050444 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:54:59.182853 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:54:59.190616 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b44e3553-5916-4e27-a300-04664f32736c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.152556 Dec 07 18:54:59.191207 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 563/1140] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:54:59 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:00.208434 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:00.209026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:00.215870 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:00.216322 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:00.217098 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:00.217533 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:00.351434 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:00.358655 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-816fb55a-8ba9-4c58-823b-39416d77098b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.153919 Dec 07 18:55:00.359220 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 578/1141] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:00 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:01.376247 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:01.376783 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:01.383176 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:01.383634 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:01.384447 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:01.384884 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:01.516305 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:01.524282 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-8ca2bd5b-df0b-452c-9844-f4e375b8c3f0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.151778 Dec 07 18:55:01.524841 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 564/1142] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:01 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:02.540351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:02.540980 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:02.547567 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:02.548014 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:02.548786 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:02.549219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:02.679372 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:02.686771 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-fd8e8c71-2086-44b5-9006-c16cca609ddc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.150068 Dec 07 18:55:02.687275 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 579/1143] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:02 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:03.703418 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:03.704029 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:03.710479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:03.710938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:03.711711 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:03.712145 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:03.840981 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:03.848142 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-3a50e3ae-df36-4ef3-a67d-6c8e1fffa50d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.148415 Dec 07 18:55:03.848699 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 565/1144] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:03 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:04.864888 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:04.865481 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:04.871862 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:04.872310 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:04.873077 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:04.873511 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:05.008470 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:05.015582 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ee3570cc-68ff-42d5-9451-353eb730a849 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.154389 Dec 07 18:55:05.016153 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 580/1145] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:04 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:06.032803 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:06.033509 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:06.040443 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:06.040889 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:06.041666 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:06.042128 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:06.142465 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-03094ef6-1b9b-4f64-9a7a-a6f7b0281056 req-f3572c5d-617a-4b59-8342-dd09fc7f10f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3fd07c-6bd1-4f65-8941-503b928649a7", "name": "network-vif-plugged", "status": "completed", "tag": "f1869558-05b2-4ac8-8e27-f283cb7d365f"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:55:06.144165 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:55:06.144165 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:55:06.152454 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-03094ef6-1b9b-4f64-9a7a-a6f7b0281056 req-f3572c5d-617a-4b59-8342-dd09fc7f10f7 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:06.153151 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-03094ef6-1b9b-4f64-9a7a-a6f7b0281056 req-f3572c5d-617a-4b59-8342-dd09fc7f10f7 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:06.167724 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-03094ef6-1b9b-4f64-9a7a-a6f7b0281056 req-f3572c5d-617a-4b59-8342-dd09fc7f10f7 service nova] Creating event network-vif-plugged:f1869558-05b2-4ac8-8e27-f283cb7d365f for instance ad3fd07c-6bd1-4f65-8941-503b928649a7 on hv-cinder-81969 Dec 07 18:55:06.173055 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-03094ef6-1b9b-4f64-9a7a-a6f7b0281056 req-f3572c5d-617a-4b59-8342-dd09fc7f10f7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096219 Dec 07 18:55:06.173943 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 581/1146] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:55:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:55:06.180696 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:06.190448 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-1fd5fb76-222d-4430-9389-e291be2747c3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.161384 Dec 07 18:55:06.191055 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 566/1147] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:06 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:55:07.207672 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:07.208589 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:07.215904 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:07.216356 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:07.217129 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:07.217560 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:07.358924 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:07.368103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-ed5543c8-d6d0-4340-a533-e0cd087125fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1266 microversion: 2.1 time: 0.164687 Dec 07 18:55:07.368917 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 582/1148] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:07 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:08.385656 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:08.386299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:08.392438 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:08.392877 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:08.393995 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:08.394421 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:08.526129 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:08.533295 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-4c905bc5-60e0-48ad-9f1e-7e64dfd5ccd0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1454 microversion: 2.1 time: 0.151377 Dec 07 18:55:08.533863 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 567/1149] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:08 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:08.550210 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:55:08.550805 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:55:08.557160 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:08.557602 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:08.558413 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:08.558840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:08.692174 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:55:08.699987 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-31aeda97-f170-4658-b1ed-82229eecb9ff tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1454 microversion: 2.1 time: 0.153474 Dec 07 18:55:08.700537 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 583/1150] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:55:08 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:55:10.396868 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-d2a2023f-cf99-41f4-ba31-ae34e13ff5a7 req-5b5caaca-fbba-4194-af7b-79ced67e60fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3fd07c-6bd1-4f65-8941-503b928649a7", "tag": "f1869558-05b2-4ac8-8e27-f283cb7d365f"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:55:10.398837 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:55:10.398837 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:55:10.405484 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d2a2023f-cf99-41f4-ba31-ae34e13ff5a7 req-5b5caaca-fbba-4194-af7b-79ced67e60fd service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:55:10.405943 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d2a2023f-cf99-41f4-ba31-ae34e13ff5a7 req-5b5caaca-fbba-4194-af7b-79ced67e60fd service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:55:10.417492 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-d2a2023f-cf99-41f4-ba31-ae34e13ff5a7 req-5b5caaca-fbba-4194-af7b-79ced67e60fd service nova] Creating event network-changed:f1869558-05b2-4ac8-8e27-f283cb7d365f for instance ad3fd07c-6bd1-4f65-8941-503b928649a7 on hv-cinder-81969 Dec 07 18:55:10.422882 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-d2a2023f-cf99-41f4-ba31-ae34e13ff5a7 req-5b5caaca-fbba-4194-af7b-79ced67e60fd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085299 Dec 07 18:55:10.423490 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 568/1151] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:55:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:57:05.371326 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:05.371947 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:05.378502 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:05.379140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:05.379929 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:05.380371 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:05.406736 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 18:57:05.479369 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-502ff222-e442-4ec7-b39c-4d1b5b1edc6c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 204 len: 0 microversion: 2.1 time: 0.112829 Dec 07 18:57:05.480223 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 584/1152] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 18:57:05 2021] DELETE /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 18:57:05.486569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8e3ba96d-b8dc-436a-bcc7-6b14cbeb3228] AMQP server on 10.222.0.41:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 07 18:57:05.491013 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:05.491703 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:05.497986 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:05.498435 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:05.499207 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:05.499643 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:05.630884 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:05.638714 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e31d5876-07fb-4f27-8aa9-56144896c5cc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1579 microversion: 2.1 time: 0.154135 Dec 07 18:57:05.639276 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 569/1153] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:05 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:06.656550 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:06.657239 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:06.663542 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:06.663982 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:06.664746 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:06.665167 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:06.801581 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:06.809741 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-da8c6882-188d-4988-8ca6-dd22cd393644 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1579 microversion: 2.1 time: 0.157262 Dec 07 18:57:06.810335 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 585/1154] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:06 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:07.827669 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:07.828271 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:07.852628 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [-] [8e3ba96d-b8dc-436a-bcc7-6b14cbeb3228] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 36114. Dec 07 18:57:07.855156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:07.855321 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-311fa6e7-d643-4ca0-a7b4-4b4ab58537cb req-96744f80-a1e9-440d-bcbc-4e65beaa6c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3fd07c-6bd1-4f65-8941-503b928649a7", "name": "network-vif-deleted", "tag": "f1869558-05b2-4ac8-8e27-f283cb7d365f"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:57:07.855814 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:07.856374 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:07.856696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:57:07.856696 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:57:07.856905 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:07.863790 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-311fa6e7-d643-4ca0-a7b4-4b4ab58537cb req-96744f80-a1e9-440d-bcbc-4e65beaa6c30 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:07.864328 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-311fa6e7-d643-4ca0-a7b4-4b4ab58537cb req-96744f80-a1e9-440d-bcbc-4e65beaa6c30 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:07.875985 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-311fa6e7-d643-4ca0-a7b4-4b4ab58537cb req-96744f80-a1e9-440d-bcbc-4e65beaa6c30 service nova] Creating event network-vif-deleted:f1869558-05b2-4ac8-8e27-f283cb7d365f for instance ad3fd07c-6bd1-4f65-8941-503b928649a7 on hv-cinder-81969 Dec 07 18:57:07.880952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-311fa6e7-d643-4ca0-a7b4-4b4ab58537cb req-96744f80-a1e9-440d-bcbc-4e65beaa6c30 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029860 Dec 07 18:57:07.885934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 586/1155] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:57:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:57:07.926804 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:07.935208 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-511feb62-b638-40f6-8355-95e2305f25c6 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 200 len: 1511 microversion: 2.1 time: 0.111492 Dec 07 18:57:07.936035 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 570/1156] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:07 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 1511 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:08.953762 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:08.954489 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:08.960514 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:08.960951 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:08.961966 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:08.962394 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:08.975145 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] HTTP exception thrown: Instance ad3fd07c-6bd1-4f65-8941-503b928649a7 could not be found. Dec 07 18:57:08.975651 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Returning 404 to user: Instance ad3fd07c-6bd1-4f65-8941-503b928649a7 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 18:57:08.976452 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-59ca7ebd-511f-4b56-8088-98b7eac61d6d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 404 len: 111 microversion: 2.1 time: 0.027450 Dec 07 18:57:08.976971 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 587/1157] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:08 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 18:57:09.070337 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2102249695", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-364844730", "security_groups": [{"name": "tempest-secgroup-smoke-1705206457"}], "block_device_mapping_v2": [{"uuid": "b9ba3c4d-0fea-490c-b4a1-c2c0c443e305", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3e28be2-bcfa-4afd-ab13-222c89764d73"}]}} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:57:09.179779 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.network.neutron [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] validate_networks() for [('c3e28be2-bcfa-4afd-ab13-222c89764d73', None, None, None, None, None)] {{(pid=122586) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:57:09.598908 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Flavor limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:57:09.599331 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Image limits 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:57:09.599806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Flavor pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:57:09.600216 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Image pref 0:0:0 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:57:09.600626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.virt.hardware [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:57:09.609801 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:09.610281 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:09.611091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:09.611528 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:09.627455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:57:09.631402 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.quota [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for user c402e3d5fad748379724a748609a04b5 and project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'instances', 'cores', 'ram'} {{(pid=122586) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:57:09.685948 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Going to run 1 instances... {{(pid=122586) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:57:09.688054 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9ba3c4d-0fea-490c-b4a1-c2c0c443e305',volume_size=None,volume_type=None)] {{(pid=122586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:57:09.809842 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [e28a57cb-8153-4e30-83c4-31a1b753220c] AMQP server on 10.222.0.41:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 07 18:57:10.828917 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [e28a57cb-8153-4e30-83c4-31a1b753220c] Reconnected to AMQP server on 10.222.0.41:5672 via [amqp] client with port 36140. Dec 07 18:57:10.833274 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5eab8a80-75a2-4d30-a662-abce7e77689b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.766721 Dec 07 18:57:10.833974 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 571/1158] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:57:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:57:10.844962 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-800e8198-7e97-4dc2-a00e-d0b8519932d9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:10.845573 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-800e8198-7e97-4dc2-a00e-d0b8519932d9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:10.899760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-800e8198-7e97-4dc2-a00e-d0b8519932d9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:10.906372 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-800e8198-7e97-4dc2-a00e-d0b8519932d9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1094 microversion: 2.1 time: 0.065168 Dec 07 18:57:10.906974 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 588/1159] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:10 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:11.924099 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:11.924713 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:11.931623 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:11.932189 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:11.932999 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:11.933530 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:12.000643 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:12.008605 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-a2fa3d55-afa4-4a57-b754-574841dcece5 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1210 microversion: 2.1 time: 0.087979 Dec 07 18:57:12.009156 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 572/1160] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:11 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:13.025673 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:13.026312 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:13.033095 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:13.033549 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:13.034823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:13.034823 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:13.054466 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-7d6d47d2-5438-4563-acd8-d1bc592d8ff6 req-fbac0ec3-9d70-49ef-ab06-ee97285e4042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6cc080b-8288-49ed-9fbd-752ad921b36d", "tag": "fd1f2634-27d9-4b10-b17b-9bed7ebdde41"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:57:13.056433 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:57:13.056433 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:57:13.063839 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-7d6d47d2-5438-4563-acd8-d1bc592d8ff6 req-fbac0ec3-9d70-49ef-ab06-ee97285e4042 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:13.064569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-7d6d47d2-5438-4563-acd8-d1bc592d8ff6 req-fbac0ec3-9d70-49ef-ab06-ee97285e4042 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:13.077445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-7d6d47d2-5438-4563-acd8-d1bc592d8ff6 req-fbac0ec3-9d70-49ef-ab06-ee97285e4042 service nova] Creating event network-changed:fd1f2634-27d9-4b10-b17b-9bed7ebdde41 for instance d6cc080b-8288-49ed-9fbd-752ad921b36d on hv-cinder-81969 Dec 07 18:57:13.096512 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-7d6d47d2-5438-4563-acd8-d1bc592d8ff6 req-fbac0ec3-9d70-49ef-ab06-ee97285e4042 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046131 Dec 07 18:57:13.097363 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 573/1161] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:57:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 07 18:57:13.195150 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:13.203574 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f5cdeed0-2a0e-4806-aaf3-60598fd90c7f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.181610 Dec 07 18:57:13.204160 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 589/1162] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:13 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:14.228366 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:14.229058 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:14.235185 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:14.235581 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:14.236349 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:14.236782 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:14.369823 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:14.377041 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ac261ee1-8c89-4558-9cf4-52c8e0c1c80f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.156691 Dec 07 18:57:14.377602 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 574/1163] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:14 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:15.394597 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:15.395213 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:15.401402 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:15.401858 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:15.402640 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:15.403065 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:15.544273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:15.551464 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-dcda4b27-6be7-424d-b53b-3c493493d65a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.160923 Dec 07 18:57:15.552029 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 590/1164] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:15 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:16.568969 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:16.569569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:16.576559 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:16.577007 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:16.577776 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:16.578235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:16.712326 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:16.719513 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-5d1591ee-a0b1-419c-aa23-efe14671ad0e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.154218 Dec 07 18:57:16.720074 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 575/1165] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:16 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:17.736617 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:17.737217 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:17.743535 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:17.743980 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:17.744738 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:17.745164 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:17.880737 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:17.889263 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-b125af54-3176-4645-9c1c-e2c5a754a0bf tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.156371 Dec 07 18:57:17.889825 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 591/1166] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:17 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:18.906708 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:18.907316 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:18.913553 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:18.914668 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:18.915818 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:18.916258 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:19.045098 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:19.052535 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-e120c2b6-f021-44e8-8fa0-dbfa383302ac tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.149513 Dec 07 18:57:19.053095 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 576/1167] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:18 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:20.069501 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:20.070131 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:20.077140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:20.077590 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:20.078403 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:20.078836 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:20.207631 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:20.215337 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-af70dbed-ab4e-4601-8705-1174e356872e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.149550 Dec 07 18:57:20.215903 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 592/1168] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:20 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:21.232040 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:21.232568 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:21.238724 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:21.239180 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:21.239955 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:21.240391 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:21.376947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:21.384681 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-30e2b150-e8dd-49c9-aebf-369126c97641 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.156377 Dec 07 18:57:21.385245 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 577/1169] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:21 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:22.404098 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:22.404690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:22.410927 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:22.411376 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:22.412147 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:22.412571 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:22.549737 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:22.557620 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-aa6ecc8d-c5d5-405e-987f-64797ee8e851 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.157595 Dec 07 18:57:22.558219 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 593/1170] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:22 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 18:57:22.753174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-d739cd3c-9da9-49b5-8942-10f725779d37 req-cfc443e5-a009-4bfe-9dd8-84bb97f1b803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6cc080b-8288-49ed-9fbd-752ad921b36d", "name": "network-vif-plugged", "status": "completed", "tag": "fd1f2634-27d9-4b10-b17b-9bed7ebdde41"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:57:22.754733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:57:22.754733 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:57:22.762556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d739cd3c-9da9-49b5-8942-10f725779d37 req-cfc443e5-a009-4bfe-9dd8-84bb97f1b803 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:22.762991 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-d739cd3c-9da9-49b5-8942-10f725779d37 req-cfc443e5-a009-4bfe-9dd8-84bb97f1b803 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:22.774405 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-d739cd3c-9da9-49b5-8942-10f725779d37 req-cfc443e5-a009-4bfe-9dd8-84bb97f1b803 service nova] Creating event network-vif-plugged:fd1f2634-27d9-4b10-b17b-9bed7ebdde41 for instance d6cc080b-8288-49ed-9fbd-752ad921b36d on hv-cinder-81969 Dec 07 18:57:22.779270 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-d739cd3c-9da9-49b5-8942-10f725779d37 req-cfc443e5-a009-4bfe-9dd8-84bb97f1b803 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029969 Dec 07 18:57:22.779855 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 578/1171] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:57:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:57:23.575463 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:23.576066 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:23.582377 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:23.582830 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:23.583598 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:23.584040 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:23.714329 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:23.722046 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-332260d6-3949-4796-b6f0-116156e92ec9 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1266 microversion: 2.1 time: 0.150163 Dec 07 18:57:23.722890 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 594/1172] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:23 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:24.746299 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:24.746994 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:24.752943 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:24.753388 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:24.754187 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:24.754618 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:24.887936 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:24.895349 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-c832323d-f4f7-42a0-b48c-2e64e0f616f8 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1453 microversion: 2.1 time: 0.154542 Dec 07 18:57:24.895921 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 579/1173] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:24 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:24.911229 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:57:24.911834 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:57:24.919046 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:24.919490 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:24.920273 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:24.920702 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:25.054161 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:57:25.061648 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-e02282a8-ecfd-47ee-ab52-edf068c8c51e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1453 microversion: 2.1 time: 0.154061 Dec 07 18:57:25.062246 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 595/1174] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:57:24 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:57:26.937032 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-a069dc62-951b-4941-9e57-9b38a8a2cff2 req-ed9c737e-4ab2-4af8-9567-5bd67564a889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6cc080b-8288-49ed-9fbd-752ad921b36d", "tag": "fd1f2634-27d9-4b10-b17b-9bed7ebdde41"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:57:26.938569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:57:26.938569 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:57:26.946637 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-a069dc62-951b-4941-9e57-9b38a8a2cff2 req-ed9c737e-4ab2-4af8-9567-5bd67564a889 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:57:26.947070 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-a069dc62-951b-4941-9e57-9b38a8a2cff2 req-ed9c737e-4ab2-4af8-9567-5bd67564a889 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:57:26.957518 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-a069dc62-951b-4941-9e57-9b38a8a2cff2 req-ed9c737e-4ab2-4af8-9567-5bd67564a889 service nova] Creating event network-changed:fd1f2634-27d9-4b10-b17b-9bed7ebdde41 for instance d6cc080b-8288-49ed-9fbd-752ad921b36d on hv-cinder-81969 Dec 07 18:57:26.963515 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-a069dc62-951b-4941-9e57-9b38a8a2cff2 req-ed9c737e-4ab2-4af8-9567-5bd67564a889 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030061 Dec 07 18:57:26.964126 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 580/1175] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:57:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:57:27.058795 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 18:57:27.059375 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: Tue Dec 7 18:57:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 18:57:53.025307 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 18:57:53.026020 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: Tue Dec 7 18:57:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 18:59:05.419480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1161251364", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-364844730", "security_groups": [{"name": "tempest-secgroup-smoke-1705206457"}], "block_device_mapping_v2": [{"uuid": "c6b471de-fd86-406d-99e8-8631f7dbde98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3e28be2-bcfa-4afd-ab13-222c89764d73"}]}} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:59:05.528637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.network.neutron [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] validate_networks() for [('c3e28be2-bcfa-4afd-ab13-222c89764d73', None, None, None, None, None)] {{(pid=122585) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 07 18:59:05.890529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Flavor limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 07 18:59:05.890960 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Image limits 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 07 18:59:05.891432 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Flavor pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 07 18:59:05.891840 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Image pref 0:0:0 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 07 18:59:05.892248 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.virt.hardware [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 07 18:59:05.901207 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:05.901650 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:05.902498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:05.902932 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:05.919655 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 07 18:59:05.923523 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.quota [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Getting quotas for user c402e3d5fad748379724a748609a04b5 and project a6c2dc4c08b44906ac2fbb104a304b3e. Resources: {'instances', 'cores', 'ram'} {{(pid=122585) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 07 18:59:05.976774 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Going to run 1 instances... {{(pid=122585) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 07 18:59:05.979934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6b471de-fd86-406d-99e8-8631f7dbde98',volume_size=None,volume_type=None)] {{(pid=122585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 07 18:59:06.098065 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-cbfa46b3-c75b-43d0-844d-a882662533fd tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.684405 Dec 07 18:59:06.098868 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 596/1176] 10.222.0.41 () {60 vars in 1146 bytes} [Tue Dec 7 18:59:05 2021] POST /compute/v2.1/servers => generated 406 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 07 18:59:06.110750 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-dd99bb80-f9f8-418c-8eb0-2a5c1a1b7d12 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:06.111458 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-dd99bb80-f9f8-418c-8eb0-2a5c1a1b7d12 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:06.164747 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-dd99bb80-f9f8-418c-8eb0-2a5c1a1b7d12 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:06.171541 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-dd99bb80-f9f8-418c-8eb0-2a5c1a1b7d12 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1094 microversion: 2.1 time: 0.066091 Dec 07 18:59:06.172111 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 581/1177] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:06 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:07.188961 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:07.189554 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:07.195649 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:07.196178 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:07.197068 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:07.203628 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:07.269107 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:07.277159 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5fe21c15-d75a-4474-a47c-be6f317c121f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1210 microversion: 2.1 time: 0.092501 Dec 07 18:59:07.278159 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 597/1178] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:07 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:08.295926 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:08.296586 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:08.304480 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:08.304831 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:08.305626 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:08.306241 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:08.318803 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [req-9c9fa759-8020-4905-8859-6c07bdd198d9 req-45b5fb06-4600-4854-9a53-bc398bd61b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d63061-3620-46c7-a7c5-7b2cc64214b9", "tag": "8086e0af-5f80-4cc9-b5b6-8955788de994"}]} {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:59:08.320743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:59:08.320743 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: warnings.warn(msg) Dec 07 18:59:08.331144 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-9c9fa759-8020-4905-8859-6c07bdd198d9 req-45b5fb06-4600-4854-9a53-bc398bd61b62 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:08.331942 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [req-9c9fa759-8020-4905-8859-6c07bdd198d9 req-45b5fb06-4600-4854-9a53-bc398bd61b62 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:08.346103 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.compute.server_external_events [req-9c9fa759-8020-4905-8859-6c07bdd198d9 req-45b5fb06-4600-4854-9a53-bc398bd61b62 service nova] Creating event network-changed:8086e0af-5f80-4cc9-b5b6-8955788de994 for instance d3d63061-3620-46c7-a7c5-7b2cc64214b9 on hv-cinder-81969 Dec 07 18:59:08.351660 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [req-9c9fa759-8020-4905-8859-6c07bdd198d9 req-45b5fb06-4600-4854-9a53-bc398bd61b62 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038483 Dec 07 18:59:08.352758 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 598/1179] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:59:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:59:08.558911 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:08.566747 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-96915d61-dfb2-4639-97fd-cf7418747986 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.276017 Dec 07 18:59:08.567314 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 582/1180] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:08 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:09.585752 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:09.586404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:09.593536 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:09.594090 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:09.594861 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:09.595291 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:09.725331 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:09.733291 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-5050b646-313f-4eb1-a664-ddd1e4f11bf0 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.152446 Dec 07 18:59:09.733856 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 599/1181] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:09 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:10.750455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:10.751066 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:10.757343 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:10.757787 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:10.758587 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:10.759020 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:10.892415 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:10.899503 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d41dfe8d-d368-4313-bc9c-dd5e43ee4aaa tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.152758 Dec 07 18:59:10.900053 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 583/1182] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:10 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:11.917573 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:11.918197 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:11.924404 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:11.924852 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:11.925619 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:11.926085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:12.060429 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:12.067690 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-71407bea-91e4-48d3-9b68-f451463bff01 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.154358 Dec 07 18:59:12.068269 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 600/1183] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:11 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:13.085289 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:13.085938 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:13.092680 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:13.093124 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:13.093886 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:13.094339 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:13.227431 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:13.234988 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-d15b9ac7-c702-40ca-bdcf-4e3f71c50ff3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.153532 Dec 07 18:59:13.235553 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 584/1184] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:13 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:14.256921 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:14.257529 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:14.264242 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:14.264709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:14.265459 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:14.265888 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:14.399702 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:14.408128 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8a46bf92-0e24-4900-9f10-11487ab5a332 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.154890 Dec 07 18:59:14.408694 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 601/1185] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:14 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:15.425310 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:15.425943 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:15.432855 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:15.433305 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:15.434120 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:15.434555 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:15.566487 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:15.573808 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-628e689a-c396-44df-a87f-4e6dd9b2ccfc tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.152211 Dec 07 18:59:15.574404 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 585/1186] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:15 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:16.591074 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:16.591709 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:16.597956 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:16.598403 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:16.599165 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:16.599595 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:16.731843 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:16.739026 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-bc42f3e9-846d-43ba-8acc-ba21851ee8f7 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.152274 Dec 07 18:59:16.739586 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 602/1187] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:16 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:17.756184 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:17.756797 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:17.763757 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:17.764209 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:17.764985 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:17.765418 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:17.896188 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:17.903717 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-72995ab8-e3ff-48db-ba81-34e8bf8f52b1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.151223 Dec 07 18:59:17.904298 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 586/1188] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:17 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:18.921189 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:18.921837 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:18.928374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:18.928819 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:18.929587 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:18.930033 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:19.064623 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:19.071932 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-abfd81e7-90cf-48a5-9302-8e8c83e2245e tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.154362 Dec 07 18:59:19.072688 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 603/1189] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:18 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:19.092560 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-45e4fbfc-6a8d-44c3-a3f2-49a86620053d req-d6757125-8324-471b-ae06-88dc889e0e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d63061-3620-46c7-a7c5-7b2cc64214b9", "name": "network-vif-plugged", "status": "completed", "tag": "8086e0af-5f80-4cc9-b5b6-8955788de994"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:59:19.094232 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:59:19.094232 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:59:19.102653 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-45e4fbfc-6a8d-44c3-a3f2-49a86620053d req-d6757125-8324-471b-ae06-88dc889e0e15 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:19.103741 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-45e4fbfc-6a8d-44c3-a3f2-49a86620053d req-d6757125-8324-471b-ae06-88dc889e0e15 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:19.116557 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-45e4fbfc-6a8d-44c3-a3f2-49a86620053d req-d6757125-8324-471b-ae06-88dc889e0e15 service nova] Creating event network-vif-plugged:8086e0af-5f80-4cc9-b5b6-8955788de994 for instance d3d63061-3620-46c7-a7c5-7b2cc64214b9 on hv-cinder-81969 Dec 07 18:59:19.125306 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-45e4fbfc-6a8d-44c3-a3f2-49a86620053d req-d6757125-8324-471b-ae06-88dc889e0e15 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032868 Dec 07 18:59:19.125306 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 587/1190] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:59:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:59:20.090508 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:20.091140 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:20.097401 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:20.097847 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:20.098644 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:20.099072 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:20.231787 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:20.238939 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-305c9124-f3de-4976-8435-eca05fbd24b3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1266 microversion: 2.1 time: 0.153509 Dec 07 18:59:20.239500 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 604/1191] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:20 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:21.256688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:21.257378 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:21.264445 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:21.264885 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:21.265640 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:21.266095 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:21.395084 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:21.402979 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-9589a01b-dddc-4daa-ad73-f74f7cc9efb3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1453 microversion: 2.1 time: 0.150344 Dec 07 18:59:21.403541 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 588/1192] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:21 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:21.419299 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 18:59:21.419899 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 18:59:21.426148 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:21.426592 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:21.427351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:21.427808 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:21.560724 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 18:59:21.568244 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-0236f187-1b90-4ec3-bd9e-580a367d01f1 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1453 microversion: 2.1 time: 0.153141 Dec 07 18:59:21.568809 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 605/1193] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 18:59:21 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 18:59:23.422021 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-89b7d2c4-a87e-46f5-b8e9-89c982351e60 req-590b3eec-873c-4a5a-b60f-9cbe3abe2f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d63061-3620-46c7-a7c5-7b2cc64214b9", "tag": "8086e0af-5f80-4cc9-b5b6-8955788de994"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 18:59:23.423539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 18:59:23.423539 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 18:59:23.430683 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-89b7d2c4-a87e-46f5-b8e9-89c982351e60 req-590b3eec-873c-4a5a-b60f-9cbe3abe2f7f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 18:59:23.431433 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-89b7d2c4-a87e-46f5-b8e9-89c982351e60 req-590b3eec-873c-4a5a-b60f-9cbe3abe2f7f service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 18:59:23.442242 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-89b7d2c4-a87e-46f5-b8e9-89c982351e60 req-590b3eec-873c-4a5a-b60f-9cbe3abe2f7f service nova] Creating event network-changed:8086e0af-5f80-4cc9-b5b6-8955788de994 for instance d3d63061-3620-46c7-a7c5-7b2cc64214b9 on hv-cinder-81969 Dec 07 18:59:23.448551 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-89b7d2c4-a87e-46f5-b8e9-89c982351e60 req-590b3eec-873c-4a5a-b60f-9cbe3abe2f7f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036368 Dec 07 18:59:23.449286 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 589/1194] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 18:59:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 18:59:42.398036 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 18:59:42.398758 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: Tue Dec 7 18:59:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 19:00:47.077924 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 19:00:47.078507 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: Tue Dec 7 19:00:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 19:01:06.008268 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:06.008890 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:06.022952 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:06.023480 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:06.024346 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:06.025419 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:06.052779 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 19:01:06.095320 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-bccc36ae-4c09-4c37-81b5-c469647a4fda req-649314da-221e-4ddf-904f-26f798fe35c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d63061-3620-46c7-a7c5-7b2cc64214b9", "tag": "8086e0af-5f80-4cc9-b5b6-8955788de994"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 19:01:06.096922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 19:01:06.096922 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 19:01:06.105006 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bccc36ae-4c09-4c37-81b5-c469647a4fda req-649314da-221e-4ddf-904f-26f798fe35c8 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:06.105495 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bccc36ae-4c09-4c37-81b5-c469647a4fda req-649314da-221e-4ddf-904f-26f798fe35c8 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:06.118926 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-bccc36ae-4c09-4c37-81b5-c469647a4fda req-649314da-221e-4ddf-904f-26f798fe35c8 service nova] Creating event network-changed:8086e0af-5f80-4cc9-b5b6-8955788de994 for instance d3d63061-3620-46c7-a7c5-7b2cc64214b9 on hv-cinder-81969 Dec 07 19:01:06.125304 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-bccc36ae-4c09-4c37-81b5-c469647a4fda req-649314da-221e-4ddf-904f-26f798fe35c8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114887 Dec 07 19:01:06.126248 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 590/1195] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 19:01:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 19:01:06.144564 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8de7eb02-b0a2-40b6-ba00-7683fd51db8f tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 204 len: 0 microversion: 2.1 time: 0.140652 Dec 07 19:01:06.145187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 606/1196] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 19:01:06 2021] DELETE /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 19:01:06.154199 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:06.155008 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:06.161365 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:06.161753 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:06.162939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:06.163573 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:06.464556 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 19:01:06.472683 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-ef040aa9-1fe8-4d95-95ce-91d5d5629769 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1578 microversion: 2.1 time: 0.323036 Dec 07 19:01:06.473455 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 591/1197] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:06 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1578 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 07 19:01:07.491194 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:07.491892 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:07.498964 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:07.499414 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:07.500187 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:07.500620 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:07.676084 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 19:01:07.683691 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-abeb0e7a-fef2-4497-aecc-e7f974343ed3 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1459 microversion: 2.1 time: 0.196545 Dec 07 19:01:07.684207 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 607/1198] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:07 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1459 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 19:01:08.199269 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-1a738481-1a5e-4d8f-9e32-3b382765fdc8 req-963153f8-0633-4661-9fb7-8703b916aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d63061-3620-46c7-a7c5-7b2cc64214b9", "name": "network-vif-deleted", "tag": "8086e0af-5f80-4cc9-b5b6-8955788de994"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 19:01:08.201290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 19:01:08.201290 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 19:01:08.208091 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-1a738481-1a5e-4d8f-9e32-3b382765fdc8 req-963153f8-0633-4661-9fb7-8703b916aa06 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:08.208496 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-1a738481-1a5e-4d8f-9e32-3b382765fdc8 req-963153f8-0633-4661-9fb7-8703b916aa06 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:08.220174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-1a738481-1a5e-4d8f-9e32-3b382765fdc8 req-963153f8-0633-4661-9fb7-8703b916aa06 service nova] Creating event network-vif-deleted:8086e0af-5f80-4cc9-b5b6-8955788de994 for instance d3d63061-3620-46c7-a7c5-7b2cc64214b9 on hv-cinder-81969 Dec 07 19:01:08.224785 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-1a738481-1a5e-4d8f-9e32-3b382765fdc8 req-963153f8-0633-4661-9fb7-8703b916aa06 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079262 Dec 07 19:01:08.225379 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 592/1199] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 19:01:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 19:01:08.702512 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:08.703129 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:08.709306 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:08.709760 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:08.710576 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:08.711048 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:08.742587 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:08.743042 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:08.743494 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.objects.instance [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lazy-loading 'fault' on Instance uuid d3d63061-3620-46c7-a7c5-7b2cc64214b9 {{(pid=122585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 07 19:01:08.786637 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 19:01:08.794360 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-733eaf51-cb6e-477b-a51a-b500b6ec6833 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 200 len: 1230 microversion: 2.1 time: 0.096099 Dec 07 19:01:08.794938 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 608/1200] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:08 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 19:01:09.815345 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:09.816135 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d3d63061-3620-46c7-a7c5-7b2cc64214b9] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:09.822235 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:09.822688 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:09.823476 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:09.823888 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:09.837697 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] HTTP exception thrown: Instance d3d63061-3620-46c7-a7c5-7b2cc64214b9 could not be found. Dec 07 19:01:09.838300 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Returning 404 to user: Instance d3d63061-3620-46c7-a7c5-7b2cc64214b9 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 19:01:09.839108 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-cb68d4d6-596d-4cdd-865e-07999c2b9e4c tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9" status: 404 len: 111 microversion: 2.1 time: 0.030257 Dec 07 19:01:09.839635 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 593/1201] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:09 2021] GET /compute/v2.1/servers/d3d63061-3620-46c7-a7c5-7b2cc64214b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 19:01:12.892514 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:12.893000 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:12.894673 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-bdc7d42d-e6ec-4f1c-8b7d-40a87b8ffa63 req-9a4a7ce0-87db-47cf-b984-2c3bd7fe3e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6cc080b-8288-49ed-9fbd-752ad921b36d", "tag": "fd1f2634-27d9-4b10-b17b-9bed7ebdde41"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 19:01:12.896265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 19:01:12.896265 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 19:01:12.899114 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:12.899565 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:12.900370 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:12.900806 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:12.905434 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bdc7d42d-e6ec-4f1c-8b7d-40a87b8ffa63 req-9a4a7ce0-87db-47cf-b984-2c3bd7fe3e4d service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:12.905876 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-bdc7d42d-e6ec-4f1c-8b7d-40a87b8ffa63 req-9a4a7ce0-87db-47cf-b984-2c3bd7fe3e4d service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:12.916902 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-bdc7d42d-e6ec-4f1c-8b7d-40a87b8ffa63 req-9a4a7ce0-87db-47cf-b984-2c3bd7fe3e4d service nova] Creating event network-changed:fd1f2634-27d9-4b10-b17b-9bed7ebdde41 for instance d6cc080b-8288-49ed-9fbd-752ad921b36d on hv-cinder-81969 Dec 07 19:01:12.922939 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-bdc7d42d-e6ec-4f1c-8b7d-40a87b8ffa63 req-9a4a7ce0-87db-47cf-b984-2c3bd7fe3e4d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031867 Dec 07 19:01:12.923525 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 594/1202] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 19:01:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 19:01:12.926744 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Going to try to terminate instance {{(pid=122585) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 07 19:01:13.010714 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-eb50f6e1-befb-45ef-b24c-06014dcd5c5a tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 204 len: 0 microversion: 2.1 time: 0.122021 Dec 07 19:01:13.012069 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 609/1203] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 19:01:12 2021] DELETE /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 07 19:01:13.021013 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:13.022019 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:13.028773 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:13.029359 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:13.030168 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:13.030600 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:13.525625 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.policy [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122586) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 19:01:13.534238 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-b743dc77-ff3f-4f2a-a342-61219304e755 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1577 microversion: 2.1 time: 0.517540 Dec 07 19:01:13.534906 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 595/1204] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:13 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1577 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 19:01:14.553037 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:14.553770 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:14.560092 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:14.560572 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:14.561359 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:14.561799 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:14.697769 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.policy [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c402e3d5fad748379724a748609a04b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6c2dc4c08b44906ac2fbb104a304b3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122585) authorize /opt/stack/nova/nova/policy.py:199}} Dec 07 19:01:14.705934 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-79e0a829-3e2b-47de-92a8-616a7137c607 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 200 len: 1459 microversion: 2.1 time: 0.156921 Dec 07 19:01:14.706785 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 610/1205] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:14 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 07 19:01:14.931130 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [req-5d592e00-bc1c-41c8-9ad0-03dcb5aab763 req-d775ee61-523c-411f-97eb-1633221bdd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6cc080b-8288-49ed-9fbd-752ad921b36d", "name": "network-vif-deleted", "tag": "fd1f2634-27d9-4b10-b17b-9bed7ebdde41"}]} {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 07 19:01:14.932792 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 07 19:01:14.932792 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: warnings.warn(msg) Dec 07 19:01:14.943699 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-5d592e00-bc1c-41c8-9ad0-03dcb5aab763 req-d775ee61-523c-411f-97eb-1633221bdd11 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:14.944145 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [req-5d592e00-bc1c-41c8-9ad0-03dcb5aab763 req-d775ee61-523c-411f-97eb-1633221bdd11 service nova] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:14.959728 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.compute.server_external_events [req-5d592e00-bc1c-41c8-9ad0-03dcb5aab763 req-d775ee61-523c-411f-97eb-1633221bdd11 service nova] Creating event network-vif-deleted:fd1f2634-27d9-4b10-b17b-9bed7ebdde41 for instance d6cc080b-8288-49ed-9fbd-752ad921b36d on hv-cinder-81969 Dec 07 19:01:14.964879 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [req-5d592e00-bc1c-41c8-9ad0-03dcb5aab763 req-d775ee61-523c-411f-97eb-1633221bdd11 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037456 Dec 07 19:01:14.965670 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 596/1206] 10.222.0.41 () {64 vars in 1317 bytes} [Tue Dec 7 19:01:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 07 19:01:15.723733 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:15.724239 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: d6cc080b-8288-49ed-9fbd-752ad921b36d] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:15.730582 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:15.731675 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:15.732636 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:15.733073 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:15.748545 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] HTTP exception thrown: Instance d6cc080b-8288-49ed-9fbd-752ad921b36d could not be found. Dec 07 19:01:15.749125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Returning 404 to user: Instance d6cc080b-8288-49ed-9fbd-752ad921b36d could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 19:01:15.749961 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-8fb9b6de-581b-4505-9a73-d6e2e92baa17 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d" status: 404 len: 111 microversion: 2.1 time: 0.030026 Dec 07 19:01:15.750498 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 611/1207] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:15 2021] GET /compute/v2.1/servers/d6cc080b-8288-49ed-9fbd-752ad921b36d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 19:01:16.191397 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:16.192006 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.compute.api [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122586) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:16.198477 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:16.198927 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:16.200229 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:16.200771 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG oslo_concurrency.lockutils [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:16.213393 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.wsgi [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] HTTP exception thrown: Instance ad3fd07c-6bd1-4f65-8941-503b928649a7 could not be found. Dec 07 19:01:16.213999 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Returning 404 to user: Instance ad3fd07c-6bd1-4f65-8941-503b928649a7 could not be found. {{(pid=122586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 19:01:16.214815 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-222d7a43-7796-4d42-9e1a-fbab31a23512 tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 404 len: 111 microversion: 2.1 time: 0.027512 Dec 07 19:01:16.215961 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 597/1208] 10.222.0.41 () {58 vars in 1238 bytes} [Tue Dec 7 19:01:16 2021] DELETE /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 19:01:16.224125 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '>' {{(pid=122585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:16.224732 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.compute.api [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] [instance: ad3fd07c-6bd1-4f65-8941-503b928649a7] Fetching instance by UUID {{(pid=122585) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 07 19:01:16.230633 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:16.231315 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:16.232085 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 07 19:01:16.232524 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG oslo_concurrency.lockutils [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Lock "334d5eb6-08fc-4490-ba4b-66711b77338f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 07 19:01:16.245767 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.wsgi [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] HTTP exception thrown: Instance ad3fd07c-6bd1-4f65-8941-503b928649a7 could not be found. Dec 07 19:01:16.246374 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: DEBUG nova.api.openstack.wsgi [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Returning 404 to user: Instance ad3fd07c-6bd1-4f65-8941-503b928649a7 could not be found. {{(pid=122585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 07 19:01:16.247278 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO nova.api.openstack.requestlog [None req-f353e34f-9015-431b-9e8b-8b535ccffa8d tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7" status: 404 len: 111 microversion: 2.1 time: 0.026851 Dec 07 19:01:16.247807 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: [pid: 122585|app: 0|req: 612/1209] 10.222.0.41 () {58 vars in 1235 bytes} [Tue Dec 7 19:01:16 2021] GET /compute/v2.1/servers/ad3fd07c-6bd1-4f65-8941-503b928649a7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 07 19:01:17.524174 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: DEBUG nova.api.openstack.wsgi [None req-6a1ab243-3909-48c6-81c8-b4a69d6cb77b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] Calling method '.version_select at 0x7f19980925e0>' {{(pid=122586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 07 19:01:17.546893 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO nova.api.openstack.requestlog [None req-6a1ab243-3909-48c6-81c8-b4a69d6cb77b tempest-TestVolumeBootPattern-218091912 tempest-TestVolumeBootPattern-218091912-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-364844730" status: 202 len: 0 microversion: 2.1 time: 0.026230 Dec 07 19:01:17.547323 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: [pid: 122586|app: 0|req: 598/1210] 10.222.0.41 () {58 vars in 1259 bytes} [Tue Dec 7 19:01:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-364844730 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 07 19:02:53.546604 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 19:02:53.547280 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: Tue Dec 7 19:02:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 19:04:07.097308 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 19:04:07.097987 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: Tue Dec 7 19:04:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 19:04:33.047569 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 19:04:33.048351 dv-cinder-819692-6-iscsi devstack@n-api.service[122585]: Tue Dec 7 19:04:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 19:06:13.564451 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 19:06:13.564947 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: Tue Dec 7 19:06:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 19:06:22.418577 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 19:06:22.419246 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: Tue Dec 7 19:06:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 07 19:06:26.107806 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 07 19:06:26.108479 dv-cinder-819692-6-iscsi devstack@n-api.service[122586]: Tue Dec 7 19:06:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!